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PREFACE 


Several  references  are  made  in  this  report  to  “low  aptitude  personnel.”  This  is 
shorthand  for  “below  average  score  on  the  Armed  Forces  Qualification  Test.”  It  should 
not  be  interpreted  as  an  evaluative  statement  about  individuals  with  low  scores  on  the 
AFQT.  AFQT  is  but  one  indicator  of  an  individual’s  aptitude  to  perform  well  in  an  Army 
job.  This  is  a  point  which  is  central  to  the  purpose  of  this  effort,  which  is  to  identify 
other  indicators  predictive  of  success  in  an  Army  job,  whether  that  success  be  reflected  in 
performance,  promotion,  reenlistment  eligibility  or  failure  to  attrit.  Thus,  the  reader  is 
advised  to  ignore  any  broad  negative  connotations  which  may  be  associated  with  the  term 
"low  aptitude  persoimel”  and  recognize  the  more  restrictive  meaning  meant  to  be 
conveyed. 


MICHAEL  G.  RUMSEY 
Chief,  Selection  and  Assignment  ^ 
Research  Unit 
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Chapter  1 
Introduction 


Background 

The  Department  of  Defense  (DoD)  and  the  Military  Services  have  long  been 
concerned  with  the  quality  of  incoming  enlisted  personnel.  Over  the  years,  intellectual 
capacity  or  cognitive  ability  has  increasingly  served  as  the  primary  measure  in  this  regard 
(Waters,  Laurence  &  Camara,  1987).  In  1940  the  principal  requirement  for  accession 
was  that  a  recruit  be  able  to  understand  simple  commands  given  in  the  English  language 
(Laurence,  Waters,  &  Perelman,  1982).  During  World  War  II,  education  screens  (e.g., 
4th-grade  reading  level)  were  applied  at  entry  to  ensure  sufficient  intellectual  capacity  to 
absorb  military  training.  After  entry,  such  screens  were  followed  by  standardized 
measures  such  as  the  Army  General  Qassifieation  Test  (AGCT),  used  to  assign  newly 
enlisted  soldiers  to  occupations.  Beginning  in  1950,  testing  programs  were  expanded  with 
the  introduction  of  a  measure  of  general  ability--the  Armed  Forces  Qualification  Test 
(AFQT).^  Other  more  specialized  tests  continued  to  be  used  by  the  individual  Services 
for  job  assignment  purposes. 

In  1976,  the  screening  and  classification  function  was  consolidated  with  the 
introduction  of  a  Joint-Service  instrument-the  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB).  Administered  prior  to  entry,  the  ASVAB  incorporated  the  AFQT  as 
well  as  other,  more  vocational,  subtests  (e.g.,  general  science,  mechanical 
comprehension).  These  subtests  were  configured  in  various  ways  to  form  classification 
composites,  such  as  general  maintenance,  electronic,  and  clerical.  Today,  new  editions  of 
the  ASVAB  and  its  AFQT  component  are  used  by  the  Services  for  both  selection  and 
occupational  assignment  purposes. 

Since  its  institution,  the  AFQT  has  served  as  the  principal  quality  gauge.  Scores 
are  typically  reported  in  five  broad  categories  of  percentile  ranges  (with  Categories  III 
and  rv  further  subdivided)  relative  to  the  national  youth  population^  as  follows: 

’  General  ability  has  typically  been  operationalized  in  terms  of  verbal  and  math  skills,  although  early 
versions  of  the  AFQT  also  contained  subtests  measuring  spatial  relations  and  knowledge  of  tool  functions. 

*  From  1950  to  1984  the  reference  population  comprised  all  men  on  active  duty  as  of  31  December  1944 
who  had  taken  the  AGCT,  which  was  later  statistically  calibrated  to  the  AFQT  scale.  Since  19^,  a 
nationally  representative  sample  of  youth,  ages  18  through  24  in  1980,  has  served  as  the  reference  population 


itegorv 

Percentile  Range 

I 

93  -  99 

II 

65-92 

IIIA 

50-64 

IIIB 

31-49 

IVA 

21-30 

rvB 

16-20 

IVC 

10-15 

V 

1-9 

By  law,  persons  who  score  in  Category  V  are  ineligible  for  military  induction  or 
enlistment.  Although  qualifying  aptitude  standards  have  varied,  persons  in  the  lower  half 
of  the  distribution  (Categories  IIIB  and  particularly  IV)  generally,  have  been  admitted 
sparingly. 

These  restrictions  reflect  the  fact  that  quality  is  always  desired.  However,  the 
military  must  also  contend  with  quantitative  manpower  demands  that  affect  the  resulting 
recruit  aptitude  distribution.  For  example,  in  response  to  past  mobilizations  (e.g..  World 
War  II,  the  Korean  conflict)  standards  were  lowered  to  meet  increased  personnel  needs. 
Since  the  end  of  the  Vietnam  War,  and  after  gaining  experience  with  all-volunteer  force 
recruiting,  the  Services  have  been  able  to  maintain  fairly  high  admission  standards. 
Particularly  over  the  last  decade  or  so,  the  Services  have  strived  for  and  achieved  record 
proportions  of  high  quality  youth  as  measured  by  the  AFQT.  For  instance,  the 
percentage  of  recruits  scoring  within  Category  IV  has  been  10%  or  less  since  1984,  and 
5%  or  less  since  1987.  In  fact,  in  FY  1992  less  than  1%  of  new  recruits  scored  in  the 
Category  IV  range.  At  the  same  time  the  Army,  along  with  the  other  Services,  has 

increased  the  proportion  of  accessions  who  score  within  the  upper  half  of  the  AFQT 

_  0 

distribution.  In  FY  1992,  75%  of  those  accepted  were  Category  IIIA  or  higher. 

Similar  positive  trends  are  evident  in  another  quality  indicator-high  school  diploma 
graduate  status.  Almost  all  recent  recruits  have  had  a  traditional  diploma,  compared  to 
an  overall  graduation  rate  of  about  75%  of  the  nation’s  youth  of  prime  military  age. 

When  AFQT  and  education  credential  status  are  combined  into  a  single  quality 
barometer,  76%  of  FY  1992  Army  accessions  were  of  high  quality  (Department  of 
Defense,  1993). 

for  interpreting  AFQT  scores. 
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Despite  these  favorable  quality  trends  and  the  current  reduction  in  force  brought 
about  by  the  events  in  Eastern  Europe  and  the  former  Soviet  Union,  there  are  reasons 
for  concern  about  the  future  recrm’ting  environment  First,  there  is  the  decrease  in  the 
population  of  17  to  21  year-olds,  from  which  the  Army  and  the  other  Services 
traditionally  recruit  Projections  indicate  that  the  size  of  the  18-year-old  cohort  will  be 
20%  smaller  in  1995  than  it  was  in  1980. 

Despite  the  mitigating  impact  of  the  drawdown,  however,  there  are  indications  that 
even  when  the  so-called  "baby-bust"  has  ended,  the  availability  of  high-quality,  male  high 
school  graduates  may  not  make  a  comeback.  This  is  possible  because  of  the  increasing 
diversity  of  the  workforce,  with  a  growing  representation  of  minorities  and  immigrants. 
This  trend  leads  ta  concerns  that,  because  of  language  deficits  and/or  relatively  deprived 
backgrounds,  many  individuals  in  the  evolving  recruit  pool  may  lack  the  necessary  skills 
for  the  types  of  jobs  that  are  available  today,  not  to  mention  in  the  future  (Educational 
Testing  Service,  1987;  Johnston  &  Packer,  1987;  Kageff  &  Laurence,  in  press).  Further 
compounding  the  problem  is  the  fact  that  this  fundamental  skills  decline  is  occurring  at  a 
time  of  fast-paced  technological  growth.  Therefore  the  competition  for  the  best  qualified 
labor  force  entrants  will  be  fierce.  Finally,  because  of  the  force  drawdown,  defense 
budget  cuts  will  almost  certainly  affect  the  recruiting  and  advertising  functions.  This  may 
mean  that  fewer  recruiters  will  have  to  work  even  more  efficiently  to  fill  the  leaner  forces 
with  high  quality  young  people. 

There  are  a  number  of  possible  strategies  that  the  Army  could  use  to  cope  with 
these  contingencies.  One  obvious,  though  costly,  solution  would  be  to  increase  enlistment 
bonuses  and  benefits  to  ensure  that  military  service  remains  an  attractive  option  for  those 
in  the  prime  recruiting  group.  This  is  most  likely  untenable  given  the  budget  deficits  and 
corresponding  constraints  on  spending.  Another  possibility  is  to  lower  operational  cutting 
scores  and  quality  goals  to  allow  a  higher  proportion  of  below-average  ^  youth  to  enter  to  the  , 
Army.  In  the  past  this  has  not  been  a  popular  approach  among  military  leaders, 
primarily  because  of  the  vast  amounts  of  data  that  indicate  that  lower  aptitude 
individuals  do  not  perform  as  well  as  their  brighter  counterparts.  However,  this  very 
solution  to  potential  manpower  problems  is  advocated  by  some  in  positions  of  power  as  a 
means  of  uplifting  the  disadvantaged  (Laurence  &  Ramsberger,  1991;  Sellman,  1992). 


^  See  Editor’s  Notes,  Note  1. 
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Similar  issues  and  problems  regarding  military  manpower  have  surfaced  in  the  past. 
During  World  War  11  and  the  Korean  Conflict,  for  instance,  there  were  relatively  high 
rejection  rates  for  military  entry  and  widespread  reports  of  in-service  performance 
deficiencies.  This  led  a  number  of  authors  to  suggest  that  the  selection  and  classification 
of  lower  aptitude  individuals  be  studied  to  determine  who  among  this  group  could  serve 
effectively  and  in  what  capacities  (Rundquist,  1967).  However,  such  efforts  were  difficult 
to  undertake  during  times  of  conflict  and  were  generally  deemed  uimecessary  during 
times  of  peace. 

Unlike  in  the  past,  the  Army  has  now  taken  a  proactive  stance  and  is  seeking  , 
strategies  for  recmiting  and  classifying  low-aptitude  personnel  ^  before  manpower  shortages  |  . 
surface  and  make  such  a  move  necessary.  This  investigation  is  the  subject  of  this  report 
It  involves  harvesting  the  lessons  learned  from  the  militaiy’s  previous  experiences  with 
large  influxes  of  Category  IVs.  ^ 

One  potentially  rich  source  of  information  in  this  regard  is  provided  by  Project 
100,000.  Beginning  in  1966,  over  300,000  low-aptitude  men  were  enlisted  or  drafted  as 
part  of  this  program,  which  was  initiated  by  then-Secretaiy  of  Defense  Robert 
McNamara  to  coincide  with  President  Lyndon  Johnson’s  War  on  Poverty.  McNamara 
sought  to  aid  the  disadvantaged  through  military  service  and  at  the  same  time  achieve  an 
equitable  distribution  of  the  benefits  and  burdens  of  service.  Further,  it  was  then  argued, 
by  accepting  large  ntombers  of  lower  aptitude  men,  information  could  be  gleaned  on  their 
in-service  experience.  These  data  could  then  provide  the  military  with  guidelines  on  the 
optimum  procedures  to  be  used  in  their  selection  and  classification. 

Towards  this  end,  a  vast  database  was  created  documenting  the  characteristics  and 

performance  of  those  who  became  known  as  the  New  Standards  Men.  Additionally,  a 

variety  of  studies  were  undertaken  to  address  such  issues  as  the  career  fields  in  which 

they  could  function  successfully,  the  attributes  that  distinguish  good  performers  from  bad, 

and  so  on.  In  the  end,  however,  such  efforts  were  apparently  hampered  by  the  fact  that 

the  nation  was  involved  in  the  conflict  in  Vietnam,  and  therefore  military  resources  were 

already  severely  taxed.  The  data  were  often  found  lacking  in  quality,  particularly  in  the 

latter  years  of  the  project.  As  the  U.S.  commitment  in  Southeast  Asia  abated,  so  did  any 

apparent  interest  in  the  selection  and  classification  of  lower  aptitude  individuals.  There 

_ ! _  '  I 

*  See  Editor’s,  Note,  Note  2,  and  Preface.  - 
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is  also  anecdotal  evidence  indicating  that  the  existing  performance  data  from  Project 
100,000  are  tainted  by  efforts  to  make  the  program  work  (Laurence  &  Ramsberger, 

1991).  That  is,  rather  then  being  treated  just  like  other  soldiers  (as  the  project’s 
guidelines  dictated),  in  many  cases  the  new  standards  men  were  "helped"  to  succeed,  both 
in  training  and  on-the-job.  Thus  the  data  from  Project  100,000,  in  addition  to  being 
dated,  can  also  be  considered  at  least  somewhat  suspect. 

A  later  episode  involving  the  inadvertent  admission  of  large  numbers  of  low- 
aptitude  recruits  provides  a  much  better  vantage  point  for  studying  their  performance. 
When  the  DoD-wide  version  of  the  ASVAB  was  put  into  place  in  1976,  there  were 
undetected  flaws  in  the  method  used  to  determine  appropriate  percentile  scores  in 
reference  to  the  normative  population.  These  errors  had  the  effect  of  inflating  scores  in 

the  lower  ability  range,  with  many  recruits  who  were  thought  to  be  of  average  aptitude 

/ 

actually  belonging  in  the  below-average,  or  Category  IV  range.  By  the  time  the  errors 
were  detected,  verified,  and  corrected  in  October  1980,  over  300,000  "Potentially 
Ineh'gibles"  or  Pis  (Greenberg,  1980)  had  entered  the  military.  Because  these  individuals 
were  accessed  unknowingly,  no  special  data  were  collected  on  them  beyond  the 
considerable  amount  contained  in  normal  service  records. 

When  the  in-service  experience  of  the  Pis  was  examined  they  were  foimd  to  have 
higher  basic  training  drop-out  rates,  lower  Skill  Qualification  Test  (SQT)  scores,  slower 
promotion  rates,  higher  attrition  rates,  and  more  non-judicial  punishments  and  courts 
martials  as  compared  to  their  higher  aptitude  counterparts  (Greenberg,  1980;  Shields  & 
Grafton,  1983;  Ramsberger  &  Means,  1987).  Such  findings,  like  those  obtained  during 
Project  100,000,  would  seem  to  confirm  the  inadvisability  of  allowing  lesser-ability  men 
into  the  military.  However,  there  may  be  some  important  qualifiers  to  this  conclusion. 

For  instance,  Vineberg,  Sticht,  Taylor,  and  Caylor  (1971)  examined  the  performance  of 
the  New  Standards  Men  from  Project  100,000  in  four  Military  Occupational  Specialties 
(MOS).  Although  ability  to  do  the  job  was  related  to  both  experience  and  aptitude, 
these  researchers  found  that  a  significant  proportion  of  low-aptitude  soldiers  were  able  to 
reach  an  adequate  level  of  performance  in  a  reasonable  time.  Further,  the  fact  that  14% 
of  the  Category  IV  personnel  admitted  during  the  ASVAB  misnorming  era  were  still  on 
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active  duty  at  the  end  of  FY  1988  can  also  be  taken  as  an  indication  that  many  lower 
aptitude  men  can  succeed  (Laurence  &  Ramsberger,  1991). 

These  latter  findings  suggest  that  by  selecting  individuals  on  the  basis  of  AFQT 
score  alone,  the  Army  may  be  losing  out  on  a  potential  source  of  personnel;  personnel 
that  may  be  needed  in  the  future  given  the  aforementioned  population  projections  and 
possible  recruiting  problems.  Determining  how  to  differentiate  more  accurately  between 
the  successful  and  unsuccessful  performers  among  this  group,  in  conjunction  with 
studying  how  below-average  aptitude  personnel  can  be  appropriately  assigned,  would 
allow  the  Army  to  tap  further  into  the  potential  manpower  pool  without  sacrificing  the 
ultimate  goal  of  a  fully-qualified  force. 

Objectives 

/ 

Cognizant  of  the  potential  expansion  of  the  role  of  low-aptitude  soldiers  in  the 
future,  the  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI) 
contracted  with  the  Human  Resources  Research  Organization  (HumRRO)  to  investigate 
augmented  selection  criteria  for  such  enlisted  personnel.  In  addition  to  isolating  relevant 
individual  characteristics  that  might  serve  as  compensatory  predictors,  the  Army  also 
seeks  to  identify  those  MOS  in  which  soldiere  of  average  to  below-average  cognitive 
ability  can  perform  most  emd  least  effectively.  Ultimately,  recommendations  regarding 
possible  compensatory  composite(s)  for  selecting  the  'Tjest"  from  among  the  low-aptitude 
population  are  sought  on  the  basis  of  the  findings  from  this  study. 

To  accomplish  these  objectives,  we  relied  on  readily  available  information  about 
lower  aptitude  individuals  from  extant  military  databases.  Such  files  contain  a  wide  range 
of  predictor  and  performance  outcome  measures.  The  predictors  include  height,  weight, 
geographic  region  of  origin,  age  at  entry,  highest  year  of  education,  marital/dependents 
status,  ASVAB  subtest  scores,  and  interest  test  results.  Performance  outcome  measures 
include  SQT  scores,  promotion  history,  length  of  service,  and  reasons  for  discharge. 

We  focused  on  those  soldiers  who  entered  the  Army  for  the  first  time  during  the 
ASVAB  misnorming  (1977-1980).  Data  on  this  large  group  of  low-aptitude  men 

t 

provided  an  opportunity  to  perform  extensive  analyses  aimed  at  identifying  alternative 


selection  criteria  and  appropriate  MOS  j  As  compared  to  Project  100,000,  data  from 
the  misnorming  are  relatively  uncontaminated.  Further,  because  these  low-aptitude 
individuals  were  brought  in  inadvertently,  many  were  assigned  to  jobs  they  might  not 
have  been  given  had  their  true  aptitude  levels  been  known. 

A  secondary  effort  within  this  project  was  to  conduct  an  expert  judgment  study. 

We  examined  the  convergence  between  relationships  discovered  by  means  of  empirical 
data  analysis  and  relationships  predicted  by  measurement  experts.  This  was  intended  to 
provide  a  basis  for  generalizing  the  findings  from  the  misnorming  era  to  the  present  day. 
More  specifically,  if  the  experts’  judgments  are  similar  to  the  empirical  validities  for 
predictors  common  across  time  frames,  it  may  suggest  that  the  Army  consider  using  such 
judgments  to  evaluate  other  predictors  for  the  selection  of  below-average  aptitude 
recruits. 

Chapter  2  presents  a  summary  of  the  research  conducted  to  date  as  part  of  this 
project  (i.e.,  predictor  and  criterion  identification,  and  MOS  selection).  Chapter  3 
describes  the  database  development  and  structure.  The  analyses  are  explained  in 
Chapter  4.  Chapter  5  discusses  the  results  of  the  expert  judgment  study  and  compares 
those  judgments  with  the  comparable  findings  in  Chapter  4.  Chapter  6  summarizes  the 
findings  and  offers  conclusions. 


^  See  Editor’s  Notes,  Note  3. 


7 


Chapter  2 

Establishing  the  Framework 


Previous  project  reports  detail  the  methods  used  to  identify  the  predictors,  criteria, 
and  MOS  that  were,  in  turn,  used  to  evaluate  selection  and  classification  procedures  for 
low-aptitude  personnel  (Ramsberger,  1991;  McCloy,  Ramsberger,  Harris,  Campbell,  & 
Laurence,  1992).  Because  this  earlier  work  forms  the  basis  for  the  efforts  described  in 
the  remainder  of  this  report,  a  brief  summary  is  presented  here. 

Predictor  Identification  and  Definition 

The  first  step  in  identifying  potential  predictors  was  to  review  past  research  on  the 
performance  of  low-aptitude  individuals  in  the  military  (Ramsberger,  1991).  The 
literature  revealed  22  predictors  or  predictor  constructs  (including  individual  ASVAB 
subtests)  that  had  been  examined  as  possible  discriminators  between  successful  and 
unsuccessful  low-aptitude  personnel.  Of  these,  jt  was  recommended  that  four  be  rejected 
because:  1)  there  was  little  in  the  way  of  evidence  suggesting  a  relationship  between  the 
construct  and  performance,  and/or;  2)  measures  of  the  construct  were  not  available  on 
the  databases  used  in  this  work.  For  example,  past  research’ suggests  that  there  is  little 
or  no  relationship  between  the  geographic  region  in  which  the  recruit  was  living  at  the 
time  of  enlistment  and  subsequent  performance.  At  the  same  time,  other  work  has 
demonstrated  that  alternate  selection  tests  (e.g.,  listening,  pattern  matching,  dial  reading) 
can  contribute  significantly  to  the  prediction  of  success/failure  among  the  low-aptitude. 
Unfortunately,  however,  such  measures  were  not  commonly  available  on  the  databases 
used  in  this  project. 

Table  1  displays  the  final  list  of  predictor  constructs  and  their  short  definitions  or 
descriptions.  The  constructs  fall  into  two  broad  categories:  cognitive  and  non-cognitive. 
The  cognitive  predictors  consist  of  abilities  such  as  those  measured  by  subtests  of  the 
ASVAB  (i.e.,  numerical  operations,  mathematical  knowledge,  mechanical  comprehension, 
general  science,  general  information,  electronics  information,  automotive  information, 
and  shop  information). 
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Table  1 

Predictor  Constructs 


Construct 

De&udon 

New  AFQT 

WK  +  AR* 

Numerical  Operations 

Speed  and  accuracy  in  performing  simple  arithmetic  operations  (i.e.,  addition, 
subtraction,  multiplication,  division). 

Mathematics  Knowledge 

Ability  to  use  simple  algebra  and  geometry  along  with  arithmetic  skills  and  reasoning 
power. 

Mechanical 

Comprehension 

Ability  to  learn,  comprehend,  and  reason  with  mechanical  terms.  More  specifically, 
the  ability  to  perceive  and  understand  the  relationships  of  physical  forces  and 
mechanical  elements  in  practical  situations. 

General  Science 

Knowledge  of  basic  scientific  principles. 

General  Information 

General  knowledge  of  a  variety  of  subjects. 

Electronics  Information 

Knowledge  of  electrical  or  electronic  systems  and  operations. 

Automotive  Information 

Knowledge  of  maintenance  and  repair  of  automotive  equipment. 

Shop  Information 

Knowledge  of  shop  terminology  and  practices  and  the  use  of  tools. 

Education 

Successful  completion  of  formal  training  through  four  years  of  high  school 

Psycholo^cal  Variables 
(Temperament) 

Characteristic  tendencies  of  emotional  responses  (e.g.,  need  for  achievement, 
altruism). 

Biographical 

Information 

Measures  an  individual’s  background  and  life  experiences. 

Interests 

Preference  for  various  activities,  characteristics,  and  tasks  (e.g.,  routine  work, 
manipulation  of  machines). 

Physical  Fitness 

Physical  capacity  to  perform  exercise.  Comprised  of  three  components:  (a)  strength- 
-ability  to  lift  heavy  objects  once;  (b)  aerobic  capacity— cardiovascular  endurance,  and 
(c)  muscular  endur2ince— ability  to  lift  heavy  objects  over  time. 

Psychomotor  Abilities 

Motor  actions  directly  resulting  from  mental  activity  (e.g.,  multi-limb  coordination, 
manual  dexterity). 

Perceptual  Speed  and 
Accuracy 

Ability  to  perceive  visual  information  quickly  and  accurately  and  to  perform 
processing  tasks  with  it  (e.g.,  comparisons). 

Spatial  Ability 

Ability  to  visualize  or  rotate  objects  and  figures  in  space. 

Age  at  Enlistment 

Age  at  which  an  individual  joins  the  Army,  typically  17  to  21  years  of  age. 

Marital  Status/Ntimber 
of  Dependents 

Having  a  spouse  and/or  one  or  more  dependent  children. 

*  During  the  time  of  the  misnorming  the  AFQT  was  made  up  of  Word  Knowledge,  Arithmetic  Reasoning, 
and  Space  Perception  subtests.  The  latter  is  not  included  in  the  current  AFQT,  and  therefore  was 
eliminated  from  the  construct  when  used  as  a  predictor  in  this  research  so  as  to  provide  a  better 
approximation  of  the  measure  now  in  use.  Note  that  all  three  subtests  were  used  to  classify  individuals 
into  AFQT  categories. 
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The  non-cognitive  predictor  category  can  further  be  subdivided  into  three 
classifications.  The  first,  called  Background  and  Interests,  incorporates  education, 
psychological  variables,  biographical  information,  interests,  and  physical  fitness.  The 
second  group  includes  psychomotor  abilities,  perceptual  speed  and  accuracy,  and  spatial 
ability;  it  is  appropriately  labelled  Psychomotor  Variables.  The  final  non-cognitive 
predictor  classification,  termed  Demographic  Variables,  includes  age  at  enlistment,  marital 
status,  and  number  of  dependents. 

Criterion  Identification  and  Definition 

The  second  step  in  conducting  this  phase  of  the  study  was  to  identify  aspects  of 
job  performance  that  could  be  used  as  criteria.  As  with  predictor  selection,  our  goals 
were  to  find  job  performance  criteria  that  define  success  in  any  MOS,  and  for  which 
scores  were  available  on  the  extant  datafiles.  The  investigation  of  previous  research 
yielded  four  criteria:  attrition,  SQT  score,  promotion,  and  reenlistment  eligibility. 

Attrition.  Attrition  is  defined  as  separating  from  the  Army  prior  to  completion  of 
the  contracted  term  of  service.  The  "contract"  entered  into  when  enlisting  in  the  military 
is  based  on  the  notion  that  the  Services  will  make  an  investment  in  an  individual 
(selection,  training,  outfitting,  transporting)  with  the  understanding  that  that  investment 
will  be  repaid  through  performance  on-the-job.  When  someone  separates  prematurely, 
the  balance  between  investment  and  return  is  altered  to  a  greater  or  lesser  extent 
depending  on  when  that  separation  occurs  (e.g.,  someone  who  exits  shortly  after 
completing  training  "pays  back"  less  than  someone  who  performs  on  the  job  for  some 
period  of  time  before  leaving).  Thus,  attrition  is  something  that  the  Army  would  prefer 
to  avoid.  As  is  detailed  in  the  next  chapter,  a  distinction  was  made  between  two  types  of 
separations:  1)  pejorative,  or  those  that  occurred  due  to  negative  reasons  directly  related 
to  the  behavior  or  character  of  the  person  in  question,  such  as  failure  to  meet 
performance  standards,  and;  2)  nonpejorative,  or  departures  that  were  event-driven  (e.g., 
death,  sole  surviving  son  status).  Because  the  latter  were  unrelated  to  characteristics  of 
the  individual,  and  thus  more  difficult  to  predict,  they  were  not  included  as  cases  of 
attrition  in  this  study. 
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SQT  Score.  The  SQT  is  a  written,  multiple-choice  test  used  in  the  past  to 
evaluate  a  soldier’s  technical  knowledge  of,  and  skill  level  proficiency  in,  his  or  her  MOS. 
Generally,  the  exam  took  approximately  two  hours  to  complete,  and  all  soldiers  in  skill 
levels  1  through  4  were  tested  annually  in  their  primary  MOS.  The  SQT  was  scheduled 
in  advance  to  allow  soldiers  to  prepare.  (See  Chapter  3  for  more  details  on  the  SQT). 

Promotion.  Advancement  in  the  Army  depends  on  factors  that  are  both  internal 
and  external  to  a  soldier’s  control.  Internal  factors  include  SQT  performance  and,  to 
some  extent,  supervisory  ratings.  External  factors  include  time  in  grade  (e.g.,  soldiers  are 
generally  awarded  the  rank  of  E-2  upon  completion  of  basic  training),  manpower  needs, 
policy  decisions,  and  the  number  of  openings  within  an  MOS. 

Reenlistment  Eligibility.  In  the  context  of  this  study,  reenlistment  eligibility  refers 
to  a  soldier’s  suitability  for  a  second  term  of  service  in  the  Army.  It  is  often  used  as  a 
summary  indicator  of  success.  Individual  achievements  as  reflected  in  SQT  performance, 
supervisor  ratings,  and  promotions  influence  reenlistment  eligibility.  However,  factors 
outside  a  soldier’s  control  also  have  an  impact,  the  most  important  of  which  is  the  need 
for  manpower-overall  and  within  a  given  MOS. 

MOS  Identification 

There  are  over  260  entry-level  Army  MOS.  To  evaluate  all  of  them  in  detail  in 
terms  of  their  suitability  for  lower  aptitude  soldiers  would  be  beyond  the  scope  of  this 
effort.  Therefore,  to  make  the  study  results  more  generalizable,  the  entry-level  MOS 
were  grouped  on  the  basis  of  several  characteristics  such  that  the  results  of  exhaustive 
analyses  of  one  job  could  then  be  generalized  to  others  in  the  same  group.  This 
grouping  process  took  place  in  three  phases:  a  literature  review,  a  cluster  analysis,  and  a 
consideration  of  other  factors  and  classification  schemes.  (See  McQoy,  et  al.  for  a 
detailed  description  of  this  work.) 

Literature  Review.  The  literature  review  focused  on  studies  of  the  performance 
of  lower  aptitude  personnel  in  specific  occupations.  Most  of  this  research  stemmed  from 
Project  100,000,  while  some  additional  studies  were  found  that  examined  the  training 
and/or  job  performance  of  those  erroneously  admitted  as  a  result  of  the  ASVAB 
misnorming. 
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This  review  revealed  that  jobs  suitable  for  low-aptitude  personnel  are 
characterized  by:  (1)  a  high  practical  performance  component;  (2)  a  long  period  of 
training,  and;  (3)  a  minimal  level  of  supervision  needed  (i.e.,  low  level  of  complexity). 
Jobs  not  suitable  for  low-aptitude  personnel,  on  the  other  hand,  have  the  following 
characteristics:  (1)  a  high  reading  and/or  computational  component;  (2)  a  requirement 
for  learning  strategies  and  information  processing  techniques;  (3)  a  high  cognitive 
component,  and;  (4)  a  need  for  technically  complex  equipment. 

Quster  Analysis.  The  next  phase  in  the  process  of  selecting  MOS^  for  evaluation 
in  terms  of  their  suitability  for  low-aptitude  personnel  was  to  perform  cluster  analyses. 
This  involved  two  steps.  First  was  an  examination  of  263  entry-level  MOS  in  terms  of 
their  attributes  on  the  44  variables  used  to  analyze  jobs  for  the  Dictionary  of 
Occupational  Titles  (DOT)  (U.S.  Department  of  Labor,  1977).  Where  possible,  variable 
codes  and  job  information  for  military-specific  occupations  were  used  (e.g..  Infantryman, 
Vulcan  Crewmember,  Antitank  Assault  Gunner).  When  such  information  was 
unavailable,  codes  for  comparable  civilian  jobs  were  substituted. 

Describing  263  jobs  in  terms  of  44  variables  is  rather  cumbersome.  So  the  first 
step  was  to  reduce  this  number  by  performing  a  factor  analysis  on  the  job  descriptive 
data.  This  resulted  in  the  following  four  principal  components:  (1)  Things  versus 
People;  (2)  Cognitive  Complexity;  (3)  Difficult  Working  Conditions,  and;  (4) 
Stress/Decision  Making.  These  four  components  accounted  for  50%  of  the  variance  in 
the  original  variables.  Although  this  is  a  rather  low  amount  of  explained  variance  for 
four  components,  it  is  similar  to  that  obtained  in  other  research  (Harris,  et  al.,  1991). 

The  second  step  in  this  process  involved  performing  cluster  analyses  on  the  factor 
loadings.  An  iterative  method  (i.e.,  k-means  cluster  procedure)  was  used,  and  a  20- 
cluster  solution  was  selected  as  providing  the  most  meaningful  differentiation. 

Other  Factors  and  Classification  Schemes.  The  third  and  final  step  in  the  MOS 
analysis  was  to  examine  other  occupational  coding  schema,  along  with  pragmatic  factors, 
to  select  representative  MOS  from  each  of  the  20  clusters.  Specifically,  we  looked  at: 

(1)  the  number  of  accessions  in  each  MOS;  (2)  the  MOS  membership  in  the  Army’s 
Career  Management  Fields  (CMF);  (3)  the  subject  matter  expert  clustering  performed 
for  Project  A,  (4)  the  Project  A  utility  values;  (5)  MOS  stability;  (6)  training  costs  for 
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each  MOS,  and;  (7)  the  degree  to  which  the  MOS  had  been  studied  in  the  past.  These  ■ 
are  described  below. 

Number  of  Accessions.  As  mentioned  previously,  we  were  interested  in 
determining  the  utility  of  alternate  predictors  for  lower  aptitude  individuals.  To  make 
within-job  comparisons  between  aptitude  levels,  we  considered  only  MOS  with  at  least 
100  Category  FV  soldiers  and  at  least  100  Category  IIIB  accessions  across  the  1977-1980 
cohorts. 

Career  Management  Fields.  The  Army’s  MOS  are  allocated  to  CMF  to  provide 
logical  career  progressions  from  entry  into  training  through  retirement  at  grade  E-9. 
During  the  years  1977  to  1980,  there  were  30  CMF.  Of  these,  25  contained  at  least  one 
MOS  that  met  the  sample  size  requirements. 

Project  A  Clusters.  For  Project  A,  entry-level  MOS  were  sorted  into  clusters  by 
Army  officers  and  MOS  experts  based  on  the  similarity  of  job  performance  requirements 
(Hoffman,  1987).  This  resulted  in  23  clusters,  4  of  which  had  no  MOS  that  met  the 
sample  size  criteria  (i.e.,  Surveyors,  Specialists,  Firefighter/Diver,  and  Technical 
Equipment  Repairer). 

Project  A  Utility  Values.  The  utility  studies  (Sadacca,  White,  Campbell,  DiFazio,  & 
Schultz,  1989;  Sadacca,  Campbell,  DiFazio,  Schultz,  &  White,  1990)  provide  information 
on  the  relative  value  of  job  performance  at  various  levels  of  proficiency  (10“*,  30"’,  SO"*, 
70’**,  and  90"*  percentiles)  for  many  of  the  MOS  in  our  sample.  Additionally,  ranges  of 
utilities  were  calculated  between  (a)  the  10"*  and  30"*  percentiles  and  (b)  the  10"’  and 
90"’  percentiles.  Using  the  utility  data  in  conjunction  with  the  clustering  results,  MOS  in 
which  poor  performers  were  expected  to  be  either  very  useful  or  of  little  use  were 
selected  from  each  cluster.  Poor  performance  was  considered  to  be  of  high  utility  when 
the  usefulness  of  individuals  performing  at  the  lO"’  percentile  was  high  and  when  the 
difference  between  the  utilities  of  10’"  percentile  and  90’"  percentile  soldiers  was  low. 

Poor  performance  was  defined  to  be  of  little  use  in  MOS  where  the  utility  of  the  lO’" 
percentile  group  was  low  and  the  10’"  to  90’"  percentile  difference  in  utility  was  great. 

MOS  Stability.  Army  MOS,  just  like  jobs  in  other  organizations,  are  dynamic.  To 
generalize  findings  to  the  current  Army  based  on  data  collected  over  a  decade  ago,  it  is 
necessary  that  the  MOS  studied  have  direct  counterparts  today.  Job  descriptive 
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information  was  used  to  ensure  that  each  MOS  chosen  is  essentially  the  same  job  today  ■ 
that  it  was  some  14  years  ago. 

Training  Costs.  Another  consideration  was  training  costs.  The  literature  review 
revealed  that  low-aptitude  soldiers  typically  take  longer  to  reach  proficiency  levels  than 
do  their  higher-ability  counterparts.  Therefore,  training  data  were  examined  to  ensure 
that  the  entire  range  of  costs  was  represented  among  the  MOS  selected.  The  cost  data 
were  derived  firom  the  Army  Manpower  Cost  System  (AMCOS)  for  the  active 
component  (Hogan,  et  al.,  1991).  Specifically,  we  used  the  average  variable  cost  of 
training  per  graduate  for  a  given  MOS  in  grades  1  through  4.  As  restricted  for  this 
application,  it  includes  all  variable  costs  of  initial  individual  training. 

Degree  Studied.  To  the  extent  possible,  we  tried  to  include  MOS  that  had  not 
been  studied  extensively  in  the  past.  For  instance,  jobs  that  had  been  thoroughly 
scrutinized  as  part  of  Project  A  were  eliminated  from  further  consideration  unless  they  fit 
the  other  criteria  particularly  well. 

Using  the  criteria  described  above,  25  MOS  were  selected  for  study.  Table  2  lists 
the  MOS  selected  and  presents  a  summary  of  their  characteristics. 

Specific  Objectives 

The  remainder  of  this  report  describes  the  analyses  of  the  relationships  between 
the  predictors  and  the  criteria,  overall  and  within  the  25  MOS.  There  were  two 
fundamental  issues.  The  first  concerned  the  possibility  of  differential  prediction  for 
aptitude  subgroups.  This  was  explored  by  examining  regression  equations  in  terms  of 
their  homogeneity.  That  is,  validity  coefficients  were  calculated  and  compared  for  each 
predictor-criterion  pair  for  AFQT  Category  IV  and  AFQT  Category  IIIB  plus  IV 
subgroups  as  well  as  across  all  AFQT  categories. 

The  second  issue  was  the  amount  of  incremental  validity  exhibited  by  alternate 
predictors  over  the  AFQT  for  the  various  aptitude  groupings.  To  test  homogeneity  of 
regression  for  incremental  validities,  analyses  similar  to  those  just  described  were 
repeated.  In  other  words,  incremental  validity  coefficients  were  calculated  and  compared 
for  all  categories  and  within  Category  IV  and  IIIB  plus  IV  subsets. 
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Table  2 

Summary  Gharacteristics  of  Selected  MOS 


MC^ 

aoster 

GVIF 

;  PirojertA’* 

UtUity 

Tratbing 

OSH 

EQ/SIGINT  Intcp-IMC 

7 

98 

E 

Low 

High 

IIB 

Infantryman 

6 

11 

A 

High 

Low 

12C 

Bridge  Crewman 

13 

12 

A 

High 

Mid-Low 

13B 

Carmon  Crewman 

13 

13 

B 

High 

Low 

15E 

PERSHING  Msl  Cmbr 

3 

13 

B 

Low 

Low 

16R 

ADA  Short  Rg  Gnry  Crmn 

6 

16 

B 

High 

Mid-Low 

27F 

VULCAN  Repairer 

9 

27 

U 

Low 

High 

3U 

Teletypewriter  Rep 

17 

29 

S 

Low 

Mid-High 

36C 

Wire  Sys  Inst/Op 

17 

31 

c 

High 

Mid-Low 

43E 

Parachute  Rigger 

20 

76 

H 

Low 

Mid-High 

SIN 

Water  Trmt  Sp 

12 

SI 

M 

Mid 

Mid-Low 

SIR 

Interior  Electrician 

8 

51 

0 

Mid 

Low 

S2D 

Pwr  Gen  Equip  Rep 

16 

63 

W 

Mid 

Mid-Low 

SSG 

NUCWPN  Maint  Spt 

1 

55 

G 

Low 

Mid-High 

61B 

Watercraft  Operator 

4 

64 

N 

High 

High 

64C 

Motor  Transport  Operator 

S 

64 

N 

High 

High 

68B 

Acft  Powerplant  Rep 

17 

67 

V 

Low 

High 

71L 

Administrative  Specialist 

7 

71 

J 

High 

Low 

71N 

Traffic  Mgt  Coord 

18 

64 

H 

Low 

High 

74D 

Computer/Machine  Op 

7 

74 

D 

Low 

Mid-High 

82C 

FA  Surveyor 

18 

13 

A 

Low 

Mid-Low 

84B 

Still  Photo  Sp 

2 

84 

R 

Mid 

High 

92B 

Medical  Lab  Sp 

15 

91 

K 

Low 

Mid-High 

94B 

Food  Service  Sp 

14 

94 

L 

High 

Mid-Low 

95B 

Military  Police 

19 

95 

P 

Low 

High 

“  Project  A  clusters: 


Training  costs: 


A  Combat  Soldier 
B  Weapons  Crewman 
C  Radio/Radar  Operations 
D  Computer  Procession 
E  Electronic  Warfare 

F  Surveyors 

G  Nuclear/Biological/Chemical 
H  Supply 
I  Specialists 
J  Clerical 
K  Medical 

L  Food  Service  and  Inspection 

Low  =  S4,000  -  S6.900 
Mid-Low  =  S7,000  -  S7,900 


M  Lab  Specialists 
N  Heavy  Equipment  Operators 
O  Trades 
P  Military  Police 
Q  Rrefightcr/Diver 
R  Arts 

S  Electronic  Repair  -  Non-Missile 

T  Technical  Equipment  Operator 

U  Missile  Repair 
V  Aircraft  Repair 
W  Mechanics 


Mid-High  =  $8,000  -  S12, 900 
High  =  $13,000  -  $45,900 
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Assuming  that  constructs  exist  that  identify  low-aptitude  individuals  who  are  likely' 
to  succeed,  classification  then  becomes  an  issue.  For  each  of  the  selected  MOS,  the  job 
proficiency  of  lower  aptitude  soldiers  was  compared  to  that  of  their  higher  aptitude 
counterparts.  Specifically,  the  outcomes  for  Category  IIIB  and  IV  recruits  on  each  of  the 
criterion  measures  (i.e.,  attrition,  SQT  score,  promotion,  and  reenlistment  eligibility)  were 
compared  to  those  for  higher  scoring  recruits.  Prediction  equations  were  developed  for 
those  MOS  that  demonstrated  the  greatest  and  least  deficits  for  below-average  and  low- 
ability  soldiers. 

In  developing  prediction  equations,  a  primary  concern  is  whether  the  equations 
better  predict  the  performance  of  low-aptitude  recruits  across,  or  within  MOS.  Other 
issues  focus  on  fairness  and  differential  prediction  for  subgroups  (e.g.,  race).  Fairness 
analyses  were  conducted  to  examine  differential  prediction  for  white  and  black  soldiers. 
Sample  sizes  were  not  large  enough  to  conduct  fairness  analyses  for  other  racial/ethnic 
subgroups  (e.g.,  Hispanic,  Asian)  or  by  gender. 
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Chapter  3 

Definition  of  Variables  and  Development  of  the  Database 


Both  the  predictor  and  criterion  measures  analyzed  in  this  study  were  drawn  from 
archival  sources.  As  a  result,  a  certain  amount  of  data  cleaning  and  variable  construction 
had  to  be  done  to  suit  the  present  purposes.  In  this  section,  we  present  in  detail  the 
operational  definitions  adopted  for  each  variable  in  the  predictor  and  criterion  sets,  and 
also  describe  the  steps  taken  to  finalize  the  database  by  defining  the  population. 

Predictor  Variables 

The  plan  called  for  the  examination  of  various  predictor  variables  that 
characterize  individual  soldiers.  A  number  of  potentially  relevant  databases  were 
examined  to  determine  which  one(s)  provided  the  most  complete  pictvure  of  a  soldier’s 
career.  In  the  end,  the  decision  was  made  to  draw  the  predictor  data  from  an  ARI- 
maintained  version  of  the  Cohort  database.  This  file  contains  three  types  of  information: 
accession,  transactional,  and  loss.  It  includes  over  60  variables  that  characterize  an  . 
individual  at  the  time  of  entry  into  service,  including  age,  gender,  race/ethnicity, 
education,  and  ASVAB  score.  Transactional  data  describe  the  soldier’s  career,  including 
such  variables  as  MOS  and  paygrade.  The  Cohort  file  used  in  this  project  reports 
transactional  data  at  two  points  in  time:  as  of  December  1990,  and  as  of  the  last  match 
with  the  master  or  loss  file  prior  to  December  1990.  Data  on  a  soldier’s  first  loss, 
including  date  and  type  of  separation,  are  recorded  for  all  types  of  separations,  with 
permanent  replacing  temporary  loss  information.  The  complete  list  of  predictor  variables 
is  presented  in  Table  3,  and  discussed  below. 

ASVAB  Subtest  Scores.  These  measures  are  straightforward.  From  the  data 
tapes  we  extracted  scores  for  each  of  the  twelve  subtests  of  ASVAB  Form  6  or  7,  that 
had  been  administered  prior  to  enlistment.  Cases  for  which  a  form  of  the  ASVAB  other 
than  6  or  7  was  used,  and  cases  of  individuals  having  invalid  scores  (i.e.,  more  than  12 
subtests  and  four  interest  measures  or  values  of  zero,  which  might  actually  indicate  that 
another  form  of  the  ASVAB  was  used),  were  deleted. 
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Table  3 

Definitions  of  Predictors 


ASVAB  Subtest  Scores 

GI  General  Information 

MK 

Mathematics  Knowledge 

NO  Numerical  Operations 

El 

Electronic  Information 

AD  Attention  to  Detail 

MC 

Mechanical  Comprehension  . 

WK  Word  Knowledge 

GS 

General  Science 

AR  Arithmetic  Reasoning 

SI 

Shop  Information 

SP  Space  Perception 

AI 

Automotiye  Information 

Interests  f Classification  Inventory') 

CM  Maintenance 

CE 

Electronics 

CA  Administrative 

CC 

Combat 

Education  at  entry 

0  Soldier  has  no  high  school  diploma,  1 

Soldier  has  a  High  School  diploma  or 

including  did  not  graduate  and 

higher 

General  Equivalency  Diploma  or 

other  Certificate  of  high  school 
attendance. 

Aee  at  Entrv  In  months 

Race  1  White  2 

Black 

3  Other 

Number  of  Dependents  at  entry  0 

No  dependents  1  Any  dependents 

Advanced  Enlistment  Grade  0 

None 

(including  spouse) 

1  Advanced  enlistment 

Physical  characteristics  Height 

grade,  with  or  without 
other  programs/options 

X  weight 

Interests.  The  interest  measures  that  were  available  from  archival  data  were  from 
the  Army’s  Classification  Inventory.  This  instrument  yielded  four  scores  indicating 
interest  in  Maintenance,  Electronics,  Administration,  and  Combat.  As  with  the  ASVAB 
subtest  scores,  these  were  readily  available  from  the  Cohort  file. 
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Education.  For  this  study,  educational  achievement  at  time  of  entry  was  defined  ■ 
as  a  dichotomous  variable:  having  a  high  school  diploma  (with  or  without  other 
education  such  as  college)  versus  other  credentials.  The  "other"  level  included  those  who 
did  not  complete  high  school,  and  those  with  a  GED  or  other  high  school-equivalency. 
We  could  not  retain  all  levels  of  this  variable  (e.g.,  all  types  of  credentials  and  all  levels 
of  education  less  than  high  school  diploma)  because  there  were  insufficient  numbers  of 
cases  in  most  instances.  Hence,  they  were  collapsed  into  the  "other"  category.  The 
inability  to  make  more  discrete  distinctions  in  this  regard  is  not  terribly  troublesome 
given  that  in  previous  research  relating  education  to  performance  outcomes,  high  school 
diploma  status  has  consistently  stood  out  as  the  most  important  benchmark. 

Dependents.  The  individual’s  number  of  dependents  (including  spouse)  at  time  of 
entry  was  also  on  the  accession  portion  of  the  datatapes.  Marital  status  was  coded 
dichotomously,  as  married  (=  1)  or  other  (=  0,  including  single,  divorced,  widowed,  etc.). 
Number  of  dependents  was  originally  coded  to  reflect  the  actual  number,  up  to  seven 
dependents,  with  8  to  15  as  a  separate  category.  These  were  combined  and  recoded  for 
this  effort  to  a  dichotomous  variable  (1  =  no  dependents,  0  =  any  dependents).  This 
eliminated  rarely  encountered  categories  of  the  variable  (i.e.,  individuals  with  more  than 
two  dependents  at  entry). 

Age.  Age  at  entry  has  been  found  to  be  associated  with  success  in  different  types 
of  jobs,  and  so  was  extracted  from  the  accession  data.  Cases  for  which  the  age  at 
enlistment  was  either  less  than  17  or  greater  than  35  were  deleted;  either  value  would 
suggest  a  miscoding  on  the  file  or  an  erroneous  enlistment. 

Race.  Although  racial  group  membership  was  included  in  the  database,  it  was  our 
intention  that  it  be  used  only  to  conduct  fairness  analyses  on  any  models  developed, 
rather  than  as  a  predictor  or  selection  variable.  From  the  accession  data,  race  was 
available  in  three  formats:  1)  White/Black/Other;  2)  as  any  of  14  ethnic  categories  (in 
addition  to  "other"  and  "none",  including,  presumably.  White),  and;  3)  as  four  categories 
of  race-ethnicity  (White  non-Spanish,  White  Spanish,  Black,  or  Malayan).  In  order  to 
capture  sufficient  observations  in  each  level  for  analysis,  the  first  definition,  with  three 
levels,  was  adopted. 
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Advanced  Enlistment  Grade.  Some  20  conditions  related  to  enlistment  options 
were  contained  in  the  accession  data,  including  unit  or  geographic  location  guarantees, 
training  or  skiU  guarantees,  buddy  program,  advanced  enlistment  grade,  and  all 
combinations  thereof.  Only  the  values  indicating  advanced  enlistment  grade,  alone  or  in 
combination  with  the  others,  were  retained  as  a  control  for  analysis.  This  is  an  option  for 
individuals  who  already  have  training  or  experience  in  a  relevant  discipline,  and  as  such 
seemed  likely  to  be  related  to  promotion. 

Physical  Characteristics.  As  no  reliable  measures  of  physical  strength  or  stamina 
were  available  from  the  data  sets,  the  variable  body  mass  was  created,  computed  as 
weight  X  height.  Outlier  values  were  defined  using  physical  standards  set  out  in  AR40- 
501,  1960.  Values  outside  those  limits  were  set  to  missing. 

Criterion  Variables 

A  review  of  the  literature  on  indicators  of  success  in  military  occupations,  in 
conjunction  with  an  examination  of  possible  criteria  contained  on  the  various  databases, 
led  to  the  selection  of  five  criterion  variables:  attrition,  reenlistment  eligibility, 
reenlistment.  Skill  Qualification  Test  (SQT)  performance,  and  promotion  rate.  The 
variables  are  listed  in  Table  4,  and  are  described  below. 

Two  datasets  were  used  to  develop  the  criteria  measures;  the  aforementioned 
ARI  Cohort,  and  the  Defense  Manpower  Data  Center’s  Special  Cohort  Accession  and 
Continuer  (DSCAC)  files.  Like  the  Cohort  file,  the  DSCAC  is  made  up  of  accession, 
transactional  (active  duty),  and  loss  information.  Unlike  the  Cohort,  which  contains  static 
snap-shots  of  a  solider’s  career  (i.e.,  as  of  certain  points  in  time),  the  DSCAC  contains  up 
to  53  blocks  of  quarterly  or  semi-annual  transactional  data  that  allows  more  precise 
identification  and  measurement  of  changes  in  status.  This  more  detailed  information  was 
particularly  critical  in  formulating  the  promotion  and  time-to-promotion  criteria.  The 
disadvantage  of  the  DSCAC  is  that  it  is  unavailable  for  the  1977  cohort.  In  spite  of  this, 
we  used  the  DSCAC  to  define  promotion  since  it  was  the  only  dataset  amenable  to 
developing  that  measure.  However,  so  that  we  could  develop  attrition  and  reenlistment 
criteria  measures  for  all  the  years  of  interest,  and  becausd  the  Cohort  file  was  amenable 
to  the  construction  of  these  measures,  we  chose  to  use  it  for  the  remaining  three  criteria. 
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Table  4 

Definition  of  Criteria 


Attrition 

» 

Defined  as  separation  for  pejorative  reasons  before  completion  of  the  first 

enlistment  term.  The  Interservice  Separation  Code  (ISC)  values  that  define 

"pejorative  reasons" 

are: 

010 

Medical  conditions  existing  prior  to  service 

016-017 

Medical,  non-disability 

022 

Dependency  or  hardship 

060-087 

Failure  to  meet  minimum  performance  or  behavioral 
standards 

091 

Erroneous  enlistment 

093 

Marriage 

095 

Minority 

096 

Conscientious  objector 

097 

Parenthood 

101-102 

Desertion,  imprisonment 

Reenlistment  Eligibility 

Defined  as  having  reenlisted  or  as  having  a  Reenlistment  Eligibility  (RE)  code 

indicating  eligibility. 

A  soldier  who  did  not  reenHst,  and  who  did  not  have  an 

interpretable  RE  code,  was  considered  eligible  if  the  ISC  was  one  of  the 

following: 

.  ^ 

001 

Expiration  of  term  of  service 

002-008 

Early  release 

040-042 

Entry  to  officer  programs 

090 

Secretarial  authority 

092 

Sole  surviving  son 

098 

Breach  of  contract  by  the  Service 

099 

Other  separation  or  discharge 

100 

Immediate  reenlistment 

103 

Record  correction 

104 

Missing  in  action  or  captured 

105 

Other,  dropped  fi-om  strength/rolls 

/  Continued  / 
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Table  4 

Definition  of  Criteria  (continued) 


Reenlistment 

Defined  as  reenlistment  that  occurs  more  than  12  months  after  the  first 
enlistment. 

Skill  Qualification  Test  Score 

Defined  as  the  standardized  percentage  score  for  the  first  SQT  taken  by  the 
soldier.  [Note  that  for  this  criterion  only,  the  soldier’s  MOS  is  defined  as  the 
SQT  MOS  rather  than  the  training  or  enlistment  MOS.]  ’ 

Promotion  Rate 

Defined  in  terms  of  increases  during  the  first  term  of  enlistment  and  the  time 
(months  after  entry)  when  the  paygrade  increase  occurred.  First  term  of 
enlistment  defined  by  reference  to  the  entry  date,  loss  date,  and  first  and/or 
second  Date  of  Last  Enlistment  DOLE): 

If: 

End  of  first  term  defined  as: 

No  DOLE  found 

Loss  date 

First  DOLE  follows  a  loss 

Loss  date 

First  DOLE  is  more  than  one  year  after 
entry 

First  DOLE  or  two  years  after 
entry,  whichever  is  later 

First  DOLE  is  less  than  one  year  after 
entry,  followed  by  permanent  loss 

Loss  date 

First  DOLE  is  less  than  one  year  after 
entry,  followed  by  second  DOLE 

Second  DOLE  or  two  years  after 
entry,  whichever  is  later 

First  DOLE  is  less  than  one  year  after 
entry,  followed  by  loss,  followed  by 
second  DOLE 

Loss  date 
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Attrition.  For  the  purposes  outlined  here,  attrition  was  defined  as  any  early 
separation  from  service  for  pejorative  reasons.  Keeping  in  mind  that  our  interest  was  in 
the  first-term  of  service,  there  were  two  key  elements  to  this  definition.  One  is  that  the 
soldier  left  the  Army  before  the  end  of  the  first  term  of  enlistment;  the  second  is  that  the 
soldier  leave  under  less  than  favorable  circumstances.  Operationally  defining  attrition  in 
this  manner  proved  somewhat  more  difficult  than  initially  anticipated.  This  was  due 
primarily  to  the  fact  that  temporary  loss  information  is  overwritten  on  an  individual’s 
record  when  subsequent  loss  data  becomes  available.  Thus,  if  a  soldier  completes  his 
first  term  of  service  and  then  reenlists,  the  record  would  show  a  separation  for  purposes 
of  immediate  reenlistment.  For  argument  sake,  let’s  say  that  early  in  the  second  term 
this  same  soldier  develops  major  disciplinary  problems  and  is  involuntarily  separated 
from  the  Army.  His  record  will  now  indicate  attrition  for  pejorative  reasons.  In 
classifying  cases  of  attrition,  therefore,  it  was  essential  to  take  steps  to  ensure  that  the 
loss  information  being  examined  was  from  the  first  term. 

With  this  in  mind,  we  used  a  variable  called  "enlistment  term"  from  the  cohort  file 
to  detect  early  first-term  separations.  These  data  are  entered  at  the  time  of  entry  into 
service,  and  reflect  the  contractual  length  of  the  initial  term.  If  a  soldier  spent  as  much 
(or  more)  time  in  the  military  as  he  was  supposed  to  (i.e.,  the  length  specified  by  the 
enlistment  term  variable),  then  he  was  not  considered  an  attrition  regardless  of 
information  concerning  the  nature  of  his  separation. 

For  those  soldiers  who  left  the  Army  at  any  time  before  the  end  of  their  term  of 
enlistment,  we  used  the  Interservice  Separation  Code  (ISC)  to  categorize  the  separation 
as  pejorative  or  not.'*  If  the  soldier  left  before  completing  the  first  term  and  the  ISC 
was  missing,  then  the  Separation  Program  Designator  code  (SPD)  was  translated  to  an 


*  The  Interservice  Separation  Codes  (ISC)  were  developed  by  the  Defense  Manpower  Data  Center 
(DMDC)  to  enable  meaningful  cross-service  comparisons  of  separation  reasons.  Originally  developed  with 
Separation  Program  Numbers  (SPN),  the  ISC  codes  are  now  based  on  the  DoD  Standard  Data  Element 
called  the  Separation  Program  Designator  (SPD).  The  first  two  positions  of  the  ISC  code  put  the  cause  for 
separation  in  a  broad  category  (e.g.,  01  =  Medical  Disqualifications),  while  the  third  position  specifies  the 
cause  within  that  broad  categpry  (e.g.,  012  =  Permanent  disability,  retired).  For  enlisted  personnel,  the  ISC 
is  usually  a  direct  translation  from  the  SPD;  however,  if  the  character  of  service'  (designating  conditions  of 
discharge)  is  other  than  Honorable,  then  the  ISC  will  be  coded  as  082,  Unsuitability  (Reason  Unknown), 
even  though  the  SPD  might  reflect  a  successful  term  of  enlistment.  Prior  to  1978,  conversion  to  ISC  was  not 
performed. 
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ISC  before  the  classification  rules  were  applied.  The  determination  as  to  which  ISCs 
would  be  considered  pejorative  was  based  on  the  Compensatory  Screening  Model  for 
Attrition  (Dempsey,  Laurence,  Waters,  &  McBride,  1991).  When  the  ISC  was  one  of 
those  listed  in  Table  4,  the  case  was  classified  as  a  pejorative  attrition. 

Note  that  soldiers  separating  from  the  Army  shortly  before  the  end  of  their  first 
term  under  early  release  programs  would  not  be  flagged  as  pejorative  attrition  using  this 
classification  scheme.  Also,  in  cases  where  the  ISC  and  SPD  were  both  missing  or  had 
invalid  coding,  the  attrition  variable  was  set  to  missing. 

Reenlistment  Eligibility.  For  our  purposes,  this  means  that  a  soldier  was  allowed 
to  reenlist  at  the  end  of  the  first  term.  We  first  stipulated  that  those  who  had  in  fact 
reenlisted  (as  defined  below)  were  considered  eligible.  Conversely,  any  soldier  who  was 
counted  as  an  attrition  was  considered  inehgible  to  reenlist.  For  the  remaining  soldiers,  if 
the  variable  "Reenlistment  Eligibility"  (RE)  was  coded  positively,  the  soldier  was 
considered  eligible.  If  the  RE  code  was  missing  or  contained  an  invalid  character,  we 
examined  the  ISC  (or  SPD,  if  ISC  was  missing)  and  applied  the  logic  described  under 
attrition. 

Reenlistment.  The  event  of  interest  was  reenlistment  that  occurred  12  months  or 
more  after  the  soldier’s  initial  entry  into  the  Army.  There  are  a  variety  of  circumstances 
under  which  an  individual  may  opt  to  reenlist  relatively  soon  in  their  first  term.  For 
instance,  a  new  recruit  may  want  a  particular  occupation  that  was  not  available  when  he 
initially  entered  the  Army.  If  that  MOS  should  open  up,  he  may  choose  to  reenlist  to 
obtain  the  assignment.  We  decided  not  to  count  such  events  as  true  reenlistments 
because  of  the  individual’s  relatively  short  tenure;  this  occurrence  doesn’t  reflect  directly 
on  performance  per  se,  which  was  the  real  interest  in  this  study. 

The  dataset  contains  each  soldier’s  most  recent  enlistment  date  as  of  December 
1990.  If  that  date  was  after  entry  by  more  than  12  months,  then  the  soldier  was  counted 
as  a  reenlistment.  If,  however,  it  was  either  the  same  as,  or  less  than  12  months  after  the 
entry  date,  then  the  soldier  was  not  counted  as  a  reenlistment.  Obviously,  cases  with 
pejorative  separations  (as  defined  above)  were  also  not  counted  as  reenlistments. 


26 


\ 

Skill  Qualification  Test  rSOT>  Score  j  Skill  Qualification  Tests  (SQT)  were 
administered  to  soldiers  firom  1977  to  1991.  Specific  versions  were  developed  for  each 
MOS  and  skill  level.  In  addition,  for  some  MOS,  separate  tracks  were  prepared  to 
address  duty  position  differences.  Originally  designed  as  a  method  of  assessing  individual 
performance  and  training  needs,  the  test  also  were  used  for  personnel  decisions.  As  such,  j 
individual  scores  were]  maintained  in  personnel  files.  By  policy,  soldiers  had  to  score  at  least  60%, 
in  order  to  verify  their  current  skill  level,  and  75%  in  order  to  quality  for  promotion  to  the  next 
higher  skill  level. 

I 

I 

I 

Although  it  appears  to  be  an  uncontaminated  performance  measure,  there  are 
some  problems  with  using  SQT  in  this  maimer.  For  one  thing,  SQTs  were  generally  first 

administered  when  a  soldier  reached  E-4,  which  typically  occurs  between  18  and  24 

/ 

months  after  entry.  However,  most  attrition  occurs  in  the  first  year  of  enlistment 
Therefore,  SQT  scores  were  unavailable  for  a  substantial  portion  of  those  cases  of 
attrition.  Another  problem  in  using  these  tests  as  performance  criteria  is  that  not  all 
MOS  had  an  SQT.  And  finally,  individuals  who  did  poorly  (by  their  own  or  their 
commander’s  standards)  may  have  repeated  the  SQT  as  often  as  annually.  Thus  there 
was  the  potential  for  a  practice  effect. 

For  this  study,  our  interest  lay  not  in  the  verify-qualify  achievements  of  soldiers, 
but  rather  in  the  actual  score  achieved.  We  recognized  the  likelihood  that  level  of  SQT 
difficulty  varied;  this  being  a  function  of  the  decentralized  development  process  rather 
than  any  inherent  differences  among  MOS  responsibilities.  To  efface  any  contaminating 
effects  of  such  variations,  all  scores  were  standardized  to  a  mean  of  100  and  standard 
deviation  of  20  with  reference  to  the  population  of  SQT  examinees  within  each  MOS, 
skill  level,  and  test  year. 

As  mentioned  earlier,  soldiers  would  normally  take  their  first  SQT  after  18  months 
in  service,  and  were  expected  to  take  the  test  again  (at  the  same  or  higher  skill  level)  at 


lAt  various  times,  the  SQT  included  a  written  multiple  choice  test  along  with  hands-on  performance 
measures.  As  indicated  here  and  in  Campbell  (1994),  questions  can  be  raised  concerning  the  validity  of 
each  of  the  SQT  components.  The  written  portions,  however,  were  somewhat  less  susceptible  to  the 
variations  in  format  and  implementation  that  plagued  the  hands-on-testing.  Thus  the  focus  here  is  limited  to 
the  written  SQT  scores  only. 
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least  every  two  years  thereafter.  In  order  to  further  standardize  the  data,  we  required 
that  for  each  soldier  only  the  (standardized)  score  from  the  first  SQT  taken  would  enter 
the  analysis. 

Finally,  the  SQT  variable  was  set  to  missing  when  any  one  of  the  following 
conditions  was  found:  1)  soldiers  had  no  score  (due  to  one  of  several  circumstances;  see 
Annex  A);  2)  no  standardizing  population  was  available;  3)  the  number  of  cases  was  so 
small  as  to  render  standardization  specious,  or;  4)  the  SQT  was  for  an  MOS  that  was  not 
among  the  25  selected  for  study. 

Promotion.  For  the  reasons  mentioned  earlier,  promotion  data  were  obtained 
from  the  DSCAC,  rather  than  the  cohort  files.  For  the  analysis  of  this  variable  we 
required  two  types  of  information  on  each  soldien  all  paygrade  increases  during  the  first 
enlistment,  and  when  each  increase  occurred  (months  after  entry).  Determining  when  an 
increase  occurred  was  relatively  simple,  as  the  "date  of  current  paygrade"  is  encod6d  in 
each  of  the  DSCAC’s  transactional  data  blocks.  In  addition  to  this,  there  was  the  need 
to  operationally  define  the  window  of  time  to  be  called  first  term.  Conceptually  this 
would  be  the  time  between  accession  and  reenlistment  or  permanent  separation  firom  the 
military.  However,  we  did  not  want  to  consider  reenlistments  that  occurred  soon  after 
accession  (within  12  months)  as  "true"  reenlistments.  Therefore,  we  compared  accession 
date,  separation  date,  and  "date  of  last  enlistment"  (DOLE)  encoded  in  each  of  the 
DSCAC’s  transactional  data  blocks’.  j  This  resulted  in  four  possible  outcomes.  1)  If  a 
solider  never  reenlisted  (i.e.,  the  DOLE  was  the  same  as  the  entry  date)  or  reenlisted 
after  permanent  separation  from  first  term,  then  the  first  term  window  was  from 
accession  to  first  separation.  2)  If  a  solider  reenlisted  within  12  months  of  entry,  the  end 
point  for  the  first  term  was  deemed  to  be  the  date  that  the  soldier  terminated  from  the 
reenlistment  term.  3)  If  the  reenlistment  was  between  12  and  23  months  of  service,  the 
duration  of  the  first  term  was  set  to  two  years.  4)  If  a  solider  reenlisted  on  or  after  24 
months  of  initial  service,  then  the  end  of  the  first  term  was  set  to  reenlistment  date.  . 

Time  to  promotion  was  calculated  as  time  between  accession  and  achieving  grade 
E-4  within  the  first-term  window  defined  above.  Outliers  were  determined  to  be  those 
soldiers  whose  time  to  E-4  (or  total  tim’e  in  service  for  those  who  never  achieved  E-4) 

When  a  soldier  reenlists,  this  date  becomes  the  new  DOLE  on  the  file. 
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exceeded  their  enlistment  term.  The  time  values  in  these  observations  were  reset  to  their 
enlistment  term.  In  addition,  those  who  achieved  E-4  after  their  term  was  completed 
(i.e.,  during  the  extension  period)  were  recounted  as  not  having  achieved  E-4  during  first 
term. 

Development  of  the  Database 

As  discussed  in  the  previous  chapter,  our  analysis  focused  on  soldiers  in  25  MOS. 
These  were  selected  to  provide  a  range  of  required  abilities  and  training.  For  all 
analyses  involving  attrition,  reenlistment,  reenlistment  eligibility,  and  promotion  rate,  the 
MOS  for  an  observation  was  that  recorded  at  enlistment.  For  the  analyses  where  SQT 
was  the  criterion  variable,  the  MOS  for  an  observation  was  that  of  the  first  SQT  taken. 
Note  that  fewer  than  six  percent  of  the  soldiers  in  the  sample  changed  their  MOS 
between  the  completion  of  training  and  their  first  SQT. 

Two  databases  were  constructed:  an  analysis  cohort  database  derived  firom  the 
files  that  the  Army  Research  Institute  has  maintained  over  the  years;  and  an  analysis 
continuer/cohort  file,  developed  from  a  combination  of  DMDC  DSCAC  and  the  Cohort 
files.  The  first  was  used  for  analyses  involving  attrition,  reenlistment,  reenlistment 
eligibility,  and  SQT  scores;  while  the  second  database  was  used  when  the  criterion  was 
promotion. 

The  sample  was  restricted  to  soldiers  who  entered  the  Army  firom  1977  to  1980  in 
any  of  the  25  MOS.  A  variety  of  global  deletions  were  imposed  on  the  data  to  eliminate 
those  with  erroneous  information  and  those  whose  status  regarding  key  variables  (e.g., 
cohort  year)  could  not  be  determined.  The  deletions,  and  their  effect  on  the  number  of 
observations  in  the  final  data  set,  are  shown  in  Table  5. 

To  construct  the  continuer  database  in  such  a  way  that  it  would  contain  the  same 
soldiers  as  are  in  the  analysis  cohort  database,  we  extracted  firom  the  continuer  file  only 
those  observations  contained  in  the  cohort  file.  By  so  doing,  the  resultant  dataset 

p 

contains  demographic,  entry,  and  loss  variables  from  the  cohort  file  and  grade  change 
data  from  the  continuer  file. 
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Table  5 

Database  Effects  of  Global  Deletions  Within  FY  1977 
Through  FY  1980  Cohorts 


Cause  of  Deletion 


Number 

Deleted 


Percent 

Deleted 


Enlistment/training  MOS  not  among  the  25  MOS 
Females 

ASVAB  subtests:  last  four  scores  less  than  10 

ASVAB  Test  Form  other  than  6  or  7 

Entry  age  less  than  17  or  over  35  years 

AFQT  score  below  10 

Entry  date  missing 

Outside  cohort  membership  window 

Entry  and  separation  dates  incompatible 

Height  less  than  60  inches  or  over  78  inches,  or 
Weight  less  than  100  pounds  or  over  275  pounds 


414,802 

21,287 

7,588 

19,626 

56 

475 

9 

133 

2,036 

5,335 


Duplicate  SSNs 

TOE  missing  or  illogical  (e.g.,  <  1  year) 

6 

3.4 

0.0 

%  of  Total 

%  of  Cohort 

Cohort 

#  Before 

%  of 

#  After 

After 

Before 

Year 

Deletions 

Total 

Deletions 

Deletions 

Deletions 

1977a 

216,883 

34.7 

49,335 

32.2 

22.7 

1978 

122,399 

19.6 

30,159 

19.7 

24.6 

1979 

128,289 

20.5 

34,745 

22.6 

27.1 

1980 

157,211 

25.2 

39,176 

25.5 

24.9 

Total 

624,782 

100.0 

153,435 

100.0 

24.6 
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In  the  cohort  database,  we  started  with  624,782  cases  (accessions  in  the  four 
cohort  years).  We  deleted  almost  415,000  cases  of  soldiers  whose  enlistment  or  training  ' 
MOS  was  not  one  of  the  selected  25,  and  over  21,000  female  soldiers*.  Nearly  2,200  cases  with 
a  missing,  out-of-range,  or  illogical  entry  date  were  also  deleted.  The  153,435  cases  in  the  resulting! 

database  represent  a  broad  cross  section  of  the  1977-1980  accessions.  The  sample  is  broken  down' 

by  AFQT  category  and  MOS  in  Table  6.  / _ 

r"  ■  '  '  • 
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Table  6 

AFQT  Composition  of  Soldiers  in  the  Database 
by  hffihtaiy  Occupational  Specialty  (MOS) 


'  AFQT 
Category 
II 

AFQfF. 

Category 

IIIA 

AFQT 

Category 

IIIB 

AFQT 

;  Category' 
IV 

m  ew/SiSHtr  Horse 
iwtereeptor 

108 

569 

•  257 

207 

122 

1,263 

1X8' 

959 

■RH 

HBEI 

— 

52,613 

30 

329 

382 

766 

■BBH 

3,123 

138  CaonoR  CrewnsR 

149 

1,580 

■1^ 

mm 

22,039 

15E  PM*shiiig  tflsslle 
Crewnember 

28 

260 

285 

542 

1,109 

• 

2,224 

16R  PBh  Short  Ratine-  - 
Cunnery  Crewman  ' 

15 

124 

136 

314 

1,695 

2,284 

27F  Volcan  Repairs* 

14 

120 

97 

147 

241 

619 

31J  Teletype  Repairer 

7 

149 

143 

256 

695 

Hnsi 

22 

265 

370 

805 

2,669 

4.131 

43E: Parachute  Rigger 

33 

261 

279 

515 

2.190 

5IK  Water  Treatflent 
Specialist 

5 

63 

76 

200 

540 

884 

SIR  IiTterlar 
Electrician  ' 

12 

158 

141 

220 

322 

853 

5ZD  Pow«*^  Gttjeration 
Equipment  Repairer 

14 

322 

325 

494 

513 

1,668 

SSfi'  Nuclecur  Weapons 
NaiRtenaflca 

Specialist 

14 

121 

86 

83 

121 

425 

61B  Watercraft 
dperatbr: 

1 

43 

32 

71 

293 

440 

*  See  Editor’s  Notes,  Note  3. 


/  Continued  / 
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Table  6 

AFQT  Composition  of  Soldiers  in  tbe  Database 
by  Militaiy  Occupational  Specialty  (MOS)  (continued) 


NOS 

AFQT 

Category 

I 

AFQT 

Category 

ir 

AFQT' 

.  Category 
niA^ 

AFQT  ^ 
Category, 
IIIB. 

AFQT 

Category 

XV 

•• 

TOTAL 

64C  Hutor  Transport 
Operator 

68 

1,391 

1,721 

3,285 

8,903 

15,368 

688  Aircraft 

Powerplant  Repairer 

10 

122 

95 

114 

6 

501 

Til  Administrative 
Special ist 

95 

1,064 

1,037 

1,592 

1,912 

5,700 

71H  Traffic 

Hanagemuit  /' ' 
CtJordinattH*  '  ' 

5 

55 

56 

•  85 

128 

329 

740  Computer/Hachine 
Operator 

14 

102 

60 

61 

87 

324 

8^C  Field  Artillery 
Surveyor 

48 

606 

478 

717 

954^ 

2,803 

84B  SttTl 

PhotograptiiC 

Specialist 

35 

93 

49 

44 

119 

340 

92B  fledieal 

Laborattry  Specialist 

69 

266 

85 

72 

57 

549 

946  Food  Service 
Specialist 

46 

653 

841 

1,922 

8,022 

11,484 

95B  Military  Police 

548 

6,056 

4,325 

4,970 

4,058 

19,957 

Note:  MOS  numbers  and  titles  are  from  the  1S)74  Army  Regulation  611>201,  "Enlisted  Career  Management  Fields 
Occupational  Specialties  (with  changes  1-19,  September  1983). 
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Chapter  4 

Empirical  Results 


Before  describing  the  empirical  relationships  between  the  various  predictors  and 
criteria  within  and  across  the  MOS  under  study,  an  overview  of  criterion  performance  by 
i4PQT  category  is  provided.  Table  7  confirms  the  typical  performance  differences  by 
AFQT:  Higher  category  personnel  generally  outperformed  lower  category  soldiers. 

There  was  an  inverse  monotonic  relationship  between  the  AFQT  categorizations  and 
SQT  score  ranging  from  a  mean  SQT  of  around  113  for  Category  I  and  II  soldiers  to  a 
mean  of  94  for  those  Category  IVC  personnel.  The  seemingly  anomalous  findings  (i.e.,  a 
deviation  from  a  monotonic  pattern)  for  Category  IVC  personnel  on  attrition,  promotion 
to  E-4,  reenlistment  eligibility,  and  reenlistment  may  be  partially  explained  by  enlistment 
circumstances  and  policies.  For  example,  enlistment  policies  stipulate  that  recruits  in 
Category  IV  must  be  high  school  diploma  graduates.  The  inadvertent  ASVAB  score 
inflation  from  FY  1977  to  1980  may  have  allowed  FVA  and  IVB  but  not  IVC  recruits  to 
skirt  this  requirement.  Being  overwhelmingly  high  school  graduates.  Category  IVC 
recruits  possessed  a  compensatory  factor  which  contributed  to  their  attrition,  promotion, 
and  reenlistment  performance. 

All  in  all.  Category  IV  recruits  as  a  whole  had  lower  job  knowledge  scores,  were 
more  likely  to  leave  service  prematurely,  were  less  likely  to  be  promoted,  and  were  less 
likely  to  be  found  eligible  to  reenlist  than  higher  aptitude  category  soldiers.  Actual 
reenlistment  rates  for  Category  IVs  were  similar  to  the  rates  found  among  higher 
category  personnel.  This  finding  is  not  necessarily  indicative  of  comparable  performance 
among  the  different  aptitude  categories  but  reinforces  the  notion  that  lower  aptitude 
recruits  not  only  have  a  greater  propensity  to  enlist  but  also  to  remain  in  service. 

These  data  support  the  Army’s  desire  to  enlist  the  highest  quality  recruits  possible. 
Yet,  the  uncertainty  of  future  recruiting  contingencies  as  well  as  the  Army’s  youth 
development  activities  (see  Ondaatje,  1993)  may  lead  to  future  influxes  of  below  average 
recruits.  To  aid  the  Army  in  its  foresighted  manpower  planning,  the  balance  of  this 
chapter  highlights  analyses  of  the  performance  of  below  average  recruits  (with  particular 
emphasis  on  Category  IV  men)  within  and  across  the  25  MOS  selected  for  study. 
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Table  7 

Peribrmance  of  FY  1977  Through  FV  1980  Non-Prior  Service  Male  Army 
Accessions  Across  2S  MOS  by  AFQT  Categoiy  and  Criterion  Measure 


The  aim  of  these  analyses  was  to  determine  whether  there  are  factors  that  could  be  used 
to  identify  the  "best"  among  the  poorer  performers. 

The  listing  of  several  performance  criteria  in  Table  8  brings  to  the  fore  that  job 
performance  in  the  Army,  as  in  any  work  environment,  is  multidimensional  Preliminary 
analyses  of  these  measures  of  success,  reduced  the  set  to  three  for  further  analytic  work- 
attrition,  promotion  to  E-4,  and  SQT.  Reenlistment  eligibility  and  actual  reenlistment 
were  dropped  for  the  following  reasons; 

•  Evidence  suggests  that  after  the  discovery  of  the  misnorming, 
efforts  were  made  to  bar  from  reenlisting  those  who  were 
inadvertently  admitted  (Laurence  &  Ramsberger,  1991). 

Thus,  smaller  percentages  of  eligibles  among  the  lower 
aptitude  may  be  a  function  of  policy  rather  than  performance. 

•  There  is  a  large  degree  of  overlap  between  the  operational 
definitions  of  attrition  and  reenlistment  eligibility.  Attrition  is 
used  as  a  screen  to  identify  those  ineligible,  and  the  attrition 
logic  is  used  to  classify  individuals  who  did  not  reenlist  and 
had  missing  or  bad  eligibility  codes.  Therefore  it  is  unclear 
how  conceptually  distinct  the  two  measures  are. 

•  As  mentioned  previously,  past  research  has  demonstrated  that 
enlistment  and  reenlistment  propensity  are  higher  among  less- 
qualified  youth.  Whether  this  is  the  result  of  a  perceived  lack 
of  alternatives  or  some  other  cause,  it  suggests  that  the  use  of 
reenlistment  rate  as  an  indicator  of  successful  performance  is 
unwarranted. 

•  It  is  unclear  whether  a  high  rate  of  reenlistment  among  the 
low-aptitude  should  be  a  goal.  That  is,  admitting  lower  ability 
men  into  the  Army  in  the  face  of  manpower  shortages  is  one 
thing.  Allowing  those  same  individuals—even  if  carefully 
selected“to  become  a  significant  part  of  the  career  force 
(e.g.,  to  assume  leadership  positions)  is  another. 

Because  one’s  standing  on  these  two  measures  is  a  function  of  several  external 
influences,  and  given  their  overlap  with  other  criteria,  and  the  lack  of  clarity  in  regard  to 
the  desirability  of  the  outcomes  they  represent,  they  were  dropped  from  further  analyses. 

Of  the  available  predictor  variables  (see  Table  3  in  the  preceding  chapter),  all 
except  race  and  advanced  enlistment  grade  were  evaluated  with  regard  to  predicting 
attrition,  promotion,  and  written  SQT  score.  Race  was  never  intended  as  a  predictor 
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per  se  but  was  included  in  the  dataset  to  gauge  the  fairness  of  selected  predictor 
composites.  Advanced  enlistment  grade  was  also  not  meant  to  be  used  as  a  predictor 
but  served  as  a  covariate  in  the  promotion  analyses  as  described  below.  Similarly, 
analyses  were  conducted  by  enlistment  term  (three  or  four  years)  when  this  variable  was 
suspected  to  have  an  impact  on  the  results.  Finally,  marital  status  and  number  of 
dependents  were  combined  and  dichotomized  because  number  of  dependents  at 
enlistment  could  not  be  reliably  determined  from  the  data  files. 

The  general  analytic  strategy  consisted  of  first  regressing  our  criteria  (i.e.,  attrition, 
promotion,  and  SQT  separately)  on  four  hierarchical  predictor  sets.  The  first  model 
comprised  AFQT  alone  and  the  second  added  high  school  graduation  status.  These 
models  provided  a  baseline  assessment  of  the  value  of  current  screening  practices  in 
identifying  the  best  of  lower  aptitude  recruits.  The  third  model  incorporated  ASVAB 
subtests  and  routinely  collected  demographics.  The  rationale  for  this  model  was  to  test 
for  the  predictive  power  and  incremental  validity  of  available  information.  Finally,  the 
fourth  model  added  interest  measures  to  the  predictor  set.  Following  these  specified 
model  regressions,  a  strictly  empirical  approach  to  model  building  was  adopted  using 
"computer-driven"  subsets  of  the  available  predictors.  From  the  various  equations 
generated  by  the  empirical  algorithm,  best  equations  were  then  chosen  on  the  basis  of 
statistical  criteria  and  rational  judgment. 

Attrition 

Survival  Analyses.  Because  the  focus  was  on  lower-aptitude  soldiers,  the  first  step 
in  conducting  attrition  analyses  was  to  identify  those  MOS-Term  of  Enlistment  (TOE) 
categories  containing  at  least  100  observations  with  complete  predictor  data  in  each  of 
the  groupings  of  interest  (IV,  IIIB/IV).  Differences  in  the  survivor  and  hazard  (attrition 
rate)  functions  within  MOS  and  TOE  were  then  examined,  with  high  school  graduation 
status  (grad-nongrad)  entered  as  a  covariate  in  the  statistical  tests.  With  the  restrictions 
regarding  number  of  cases,  27  tests  were  performed  comparing  Categories  I-IIIB  and  IV. 
The  MOS/TOE  combinations,  and  their  associated  Ns  are  shown  in  Table  8. 


Table  8 

MOS/rOE  Categories  Meeting  Size  Requirements  for  AFQT  Groupings 
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Table  8 

MOS/TOE  Categories  Meeting  Size  Requirements  for  AFQT  Groupings  (continued) 


MOS 

TOE 

CktegCuylV 

Categories  nili  &  IV 

Caieg(nies  I-IV 

lAiy 

4 

• 

145 

310 

82C 

3 

871 

1,156 

2,465 

84B 

4 

* 

120 

262 

94B 

3 

7,693 

9,511 

10,964 

94B 

4 

• 

110 

137 

95B 

3 

3,859 

8,491 

18,561 

95B 

4 

ft 

173  • 

382 

•  N  <100 


Only  four  of  the  27  comparisons  resulted  in  statistically  significant  differences  (2  < 
.01)  between  aptitude  groups:  IIB,  4-year  TOE;  13B,  3-year  TOE;  64C,  3-year  TOE, 
and;  95B,  3-year  TOE.  The  plots  of  the  hazard  functions  through  18  months  are  shown 
in  Figures  1  through  A?  As  demonstrated  in  past  research  (Buddin,  1984),  most  attrition 
occurs  in  the  first  six  months  after  enlistment.  In  fact,  in  all  four  cases  shown  here,  the 
rate  of  separations  peaked  in  the  first  two  months.  The  aptitude  group  comparisons 
show  a  mixed  bag,  with  the  hazard  rate  for  I-IIIB  attrition  equal  to  or  higher  than  that  of 
Category  IVs  at  various  times  in  all  four  MOS.  Note  that  high  school  graduation  status 
was  a  significant  covariate  in  all  of  the  statistical  comparisons. 

When  Categories  IIIB  and  IV  were  combined,  the  number  of  MOS/TOE 
groupings  meeting  the  size  requirement  rose  to  34  (Table  8).  Eight  of  these  comparisons 
were  significant,  as  shown  in  Figures  5  through  12.  Although  the  overall  patterns  were 
similar  to  those  seen  earlier,  the  addition  of  IIIBs  to  the  IVs  resulted  in  consistently 
higher  rates  of  attrition  among  this  group.  The  large  jump  in  the  hazard  function  at  the 
end  of  the  time  period  (e.g.,  74D,  4  year  TOE)  may  be  spurious  --  attributable  to  the 
reduced  sample  size. 


^  Note  that  these  functions  are  unaffected  by  the  covariate,  which  is  taken  into  account  only  in  the  statistical 
tests  of  the  differences  between  functions. 
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Probability  ot  Allrltlon  ^  Probability  ol  Atlrlllon 


Hazard  Funcdon  Comparisons  -  Attrition 
IIB,  4YR  TOE,  I-mB  vs.  IV 


Figure  2. 


Hazard  Function  Comparisons  --  Attrition 
13B,  3YR  TOE,  I-IIIB  vs.  IV 


Probability  of  Attrition 


0.10 


♦  Ml  IB  (6.131 
^  IV  (8.481) 


Figure  3.  Hazard  Function  Comparisons  -  Attrition 
64C,  3YR  TOE,  I-IHB  vs.  IV 


Figure  4. 


Hazard  Function  Comparisons  -  Attrition 
95B,  3YR  TOE,  I-mB  vs.  IV 


Probability  ol  Attrition  ^  Probability  of  Attrition 


0.10 


♦  l-IIIA  (6,496) 

^  IIIB&IV  (27,560) 


Hazard  Function  Comparisons  —  Attrition 
IIB,  3YR  TOE,  I-mA  vs.  IIIB/IV 


Figure  6.  Hazard  Function  Comparisons  ~  Attrition 
IIB,  4YR  TOE,  I-mA  vs.  mB/IV 


Rgure  7.  Hazard  Function  Comparisons  -  Attrition 
43E,  SYR  TOE,  I-IIIA  vs.  niB/IV 


Figure  8.  Hazard  Function  Comparisons  ~  Attrition 
74D,  4YR  TOE,  I-IIIA  vs.  niB/IV 
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Hgure  9.  Hazard  Function  Comparisons  -  Attrition 
82C,  3YR  TOE,  I-mA  vs.  IIIB/IV 


Figure  10.  Hazard  Function  Comparisons  -  Attrition 
84B,  4YR  TOE,  I-IIIA  vs.  mB/IV 
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Figure  13.  Hazard  Function  Comparisons  —  Attrition 

1  IB,  4YR,  High  School  Graduate  vs.  Nongraduate 


Education  was  a  significant  covariate  in  all  cases  except  for  43 E,  3-year  TOE.  To 
further  demonstrate  the  strength  of  the  high  school  diploma-attrition  relationship,  the 
hazard  rates  of  graduates  and  nongraduates  in  IIB,  4-year  TOE  were  compared  (see 
Figure  13).  These  results  clearly  show  what  the  results  of  many  studies  before  have 
proven;  high  school  graduation  status  is  strongly  related  to  attrition  behavior.  They  may 
also  serve  to  explain  the  relative  lack  of  differences  between  the  various  aptitude  groups. 
In  general,  those  with  lower  AFQT  scores  were  more  likely  to  be  required  to  have  a  high 
school  diploma  to  be  accepted  into  the  Army.  Thus  a  key  attribute  commonly  linked  to 
completion  of  first  term  was  more  prevalent  among  those  of  lower  aptitude. 

Proportional  Hazard  Regression  Models.  Proportional  hazard  regression  (Cox, 
1972)  was  used  to  model  the  relationship  between  first-term  attrition  behavior  and  the 
predictors  described  above.  Again,  MOS/TOE  groups  were  included  only  if  they 
contained  more  than  100  low-aptitude  solders  with  complete  predictor  data.  Two  types 
of  analyses  were  conducted. 
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First,  the  four  rationally  developed  sets  of  predictors  were  entered  hierarchically, 
with  absolute  and  incremental  fit  statistics  calculated  at  each  point.  The  four  models 
were  the  following: 


Variables 


AFQT* 

AFQT,  High  School  Graduation  Status  (HS) 

AFQT,  HS,  ASVAB  subtests  (General  Science 
(GS),  Mechanical  Comprehension(MC),  Spatial 
Perception  (SP),  Autoniotive  Information  (AI), 
Shop  Information  (SI),  Electronics  Information 
(El),  General  Information  (GI),  Attention  to 
Detail  (AD),  Numerical  Operations  (NO),  Age 
at  Entry  (AGE),  Have  dependents  at  entry 
(NODEP),  and  Body  Mass  (BMASS)  (height  x 
weight) 

4  AFQT,  HS,  ASVAB  subtests.  Interest  Measures 

(Administrative  Interest  (CA),  Outdoors 
Interest  (CC),  Electronics  Interest  (CE),  and 
Mechanical  Interest  (CE)) 


Model 

1 

2 

3 


The  second  set  of  analyses  used  the  "best  subset  selection"  option  in  the  SAS 
procedure  PHREG  to  generate  empirically  a  set  of  models  having  the  best  fit  to  the 
data.  Given  a  pre-specified  number  of  equations,  the  procedure  determines  that  number 
of  best-fittirig  equations  containing  one  predictor  variable,  two  predictor  variables,  and  so 
on,  up  to  the  single  equation  containing  all  predictors.  In  our  analyses,  we  programmed 
the  procedure  to  provide  the  three  best  models  for  each  number  of  predictors.  Thus,  the 
best  subset  selection  analyses  resulted  in  the  three  best-fitting  single-variable  solutions, 
the  three  best-fitting  two-variable  solutions,  and  so  on.  The  results  of  a  typical  run  are 
given  in  Table  9. 


®  A  constructed  AFQT  simulating  the  current  operational  AFQT  and  consisting  of  AR  and  WK,  was  used 
as  a  predictor  in  all  cases.  Aptitude  categories,  however,  were  based  on  the  older  AFQT  score. 
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Table  9 

Empirically  Derived  Best  Models  for  Predicting  Attrition 
Among  AFQT  Category  IllB  &  IV  Recruits 


MOS  95B,  3-year  TOE  (N  =  8,491) 


# 

Variables 
in  Model 

Best  Predictors 

Score 

Value 

1 

HS 

432.09 

NODEP 

5437 

GI 

31.71 

2 

HS  AGE 

463.20 

HS  NODEP 

459.68 

HS  GI 

449.23 

3 

HS  GI  AGE 

480.08 

HS  GI  NODEP 

476.87 

HS  AGE  NODEP 

47531 

4 

HS  GI  AGE  NODEP 

49230 

HS  GI  AGE  CA 

486.82 

HS  AGE  NODEP  CC 

48630 

5 

HS  GI  AGE  NODEP  CA 

498.97 

HS  GI  AGE  NODEP  CC 

497.88 

HS  MS  GI  AGE  NODEP 

496.48 

6 

HS  SI  GI  AGE  NODEP  CA 

504.05 

HS  GI  AGE  NODEP  CA  CC 

503.87 

HS  MC  GI  AGE  NODEP  CA 

503.61 

7 

HS  SI  El  GI  AGE  NODEP  CA 

507.97 

HS  MC  GI  AGE  NODEP  CA  CC 

50730 

HS  SI  GI  AGE  NODEP  CA  CC 

507.25 

8 

HS  MC  SI  El  GI  AGE  NODEP  CA 

HS  SI  El  GI  AGE  NODEP  CA  CC 

HS  MC  El  GI  AGE  NODEP  CA  CC 

9 

HS  MC  SI  El  GI  AGE  NODEP  CA  CC 

HS  SP  SI  El  GI  AGE  NODEP  CA  CC 

HS  MC  AI  SI  El  GI  AGE  NODEP  CA 

10 

HS  MC  AI  SI  El  GI  AGE  NODEP  CA  CM 

HS  MC  AI  SI  El  GI  AGE  NODEP  CA  CC 

HS  MC  SP  SI  El  GI  AGE  NODEP  CA  CC 

516.28 

11 

HS  MC  AI  SI  El  GI  AGE  NODEP  CA  CC  CM 

HS  MC  AI  SI  El  GI  AGE  NODEP  BMASS  CA  CM 

HS  MC  SP  AI  SI  El  GI  AGE  NODEP  CA  CC 

518.23  11 

12 

HS  MC  AI  SI  El  GI  AGE  NODEP  BMASS  CA  CC  CM 

■B 

HS  MC  SP  AI  SI  El  GI  AGE  NODEP  CA  CC  CM 

HS  MC  AI  SI  El  GI  AD  AGE  NODEP  CA  CC  CM 

519.79 
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Table  9 

Empirically  Derived  Best  Models  for  Predicting  Attrition 
Among  Army  Male  AFQT  Category  IIIB  &  IV  Recruits  (continued) 


# 

Score 

Variables 
in  Model 

Best  PredietDcs 

Value 

13 

HS  MC  SP  AI  SI  El  GI  AGE  NODEP  BMASS  CA  CC  CM 

— 

AFQT  HS  MC  SP  AI  SI  El  GI  AGE  NODEP  CA  CC  CM 

HS  MC  AI  SI  El  GI  AD  AGE  NODEP  BMASS  CA  CC  CM 

521.21 

14 

AFQT  HS  MC  SP  AI  SI  El  GI  AGE  NODEP  BMASS  CA  CC  CM 

522.68 

HS  MC  SP  AI  SI  El  GI  AD  AGE  NODEP  BMASS  CA  CC  CM 

522.53 

HS  MC  SP  AI  SI  El  GI  AGE  NODEP  BMASS  CA  CC  CE  CM 

522.32 

15 

AFQT  HS  MC  SP  AI  SI  El  GI  AD  AGE  NODEP  BMASS  CA  CC  CM 

523.29 

AFQT  HS  MC  SP  AI  SI  El  GI  AGE  NODEP  BMASS  CA  CC  CE  CM 

523.04 

AFQT  HS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  BMASS  CA  CC  CM 

523.02 

16 

AFQT  HS  MC  SP  AI  SI  El  GI  AD  AGE  NODEP  BMASS  CA  CC  CE  CM 

523.62 

AFQT  HS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  BMASS  CA  CC  CM 

523.41 

AFQT  HS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  BMASS  CA  CC  CE  CM 

523.36 

17 

AFQT  HS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  BMASS  CA  CC  CE  CM 

523.73 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  AGE  NODEP  BMASS  CA  CC  CE  CM 

523.63 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  BMASS  CA  CC  CM 

523.41 

18 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  BMASS  CA  CC  CE  CM 

523.74 

The  equations  were  selected  based  upon  their  value  of  the  chi-square  score 
statistic.  When  examining  the  models,  we  first  looked  for  substantial  jumps  in.  the  value 
of  the  score  statistic.  Large  increases  indicate  likely  significant  increases  in  the  fit  of  the 
associated  model  to  the  data.  Unlike  the  chi-square  statistics  for  nested  structural 
equation  models  (such  as  those  obtained  using  LISREL),  however,  the  difference 
between  score  chi-square  values  for  two  models,  one  nested  within  the  other,  is  not 
asymptotically  distributed  as  chi-square.  Thus,  evaluating  whether  additional  predictor 
variables  significantly  increased  the  fit  of  the  prediction  equation  to  the  data  required  five 
steps: 

1)  Select  a  set  of  nested  "best  subset"  models  (this  resulted  in  occasional 
selection  of  a  second  or  third  best  equation  to  retain  the  nested  property  as 
predictors  were  added); 

2)  Estimate  regression  parameters  for  these  equations  using  PHREG; 
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3)  Record  the  values  of  -2  Log  L  (the  log  of  the  likelihood  function  for  the 
regression  model  multiplied  by-2)  for  each  of  the  equations; 

4)  Obtain  the  differences  between  the  -2  Log  L  for  each  of  the  nested 
equations;  these  differences  are  asymptotically  distributed  as  chi-square 
with  degrees  of  freedom  equal  to  the  difference  between  the  number  of 
parameters  in  the  model,  and; 

5)  Determine  if  the  difference  is  significant  as  a  chi-square  statistic  with  the 
appropriate  degrees  of  freedom  (typically  one). 

In  the  example  shown  in  Table  9,  substantial  increases  in  the  score  value  obtained 
are  seen  through  the  six-variable  models.  The  values  of  -2  Log  L  indicate  that  the  four 
variable  model  (HS,  GI,  AGE,  NODEP)  is  the  last  stage  at  which  incremental  fit  is 
observed.  Hence,  this  model  is  targeted  as  the  "best"  model. 

Specified  Models.  Tables  10  through  12  present  the  results  achieved  when  the 
four  models  were  specified  as  described  above  for  Category  IV,  IIIB  and  IV,  and  all 
soldiers  in  a  given  MOS,  respectively.  Statistics  are  also  provided  for  each  aptitude 
group  collapsed  across  MOS.  For  model  1,  significance  of  AFQT  as  a  predictor  of 
attrition  was  obtained.  For  the  remaining  models,  the  incremental  significance  over  the 
previous  model  was  indicated.  As  might  be  expected,  model  2  (including  high  school 
graduation  status)  was  the  most  uniformly  significant  across  MOS,  TOE,  and  aptitude 
groups.  It  provided  incremental  fit  in  88%  of  the  analyses,  as  compared  to  55%  for 
model  3  (AFQT,  HS,  and  subtests)  and  20%  for  model  4  (AFQT,  HS,  subtests,  and 
interest  measures).  The  fact  that  all  models  provided  significant  incremental  fit  when 
MOS  were  collapsed  was  most  likely  because  of  the  large  Ns  involved. 

Once  again,  high  school  graduation  status  was  shovm  to  have  a  strong  relationship 
to  attrition  behavior.  However,  the  fact  that  Model  3,  in  particular,  was  significant  in  a 
substantial  number  of  cases  suggests  that  other  predictors  may  also  be  useful  in 
distinguishing  between  those  likely  and  unlikely  to  complete  their  first  term  of  service. 
Therefore,  the  best  models  were  investigated. 
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Table  10 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 

(Category  IV) 


ENLISTMENT  TERM  3 


#of 

% 

Chi 

;  Name 

MOS 

N 

Events 

Attrition 

Model 

-2  Log  L 

Square* 

Infantryman 

IIB 

20,434 

9,281 

45.42 

1 

178,893.94*** 

2 

178,182.85  • 

711.09 

3 

177,%9.98 

212.87 

4 

177,949.89 

20.09 

Bridge  Crewmember 

12C 

1,550 

574 

37.03 

n 

8,166.14 

■hBI 

77.09** 

8,072.49 

iiii 

■  8,070.87 

HBl 

Cannon  Crewmember 

13B 

9,894 

4,033 

40.76 

B 

72,166.49*** 

71,625.82 

540.67 

71,554.89 

70.93** 

KB 

71,53823 

16.66** 

Pershing  Crewmember 

946 

45.56 

B 

5,661.95* 

5,63159 

3036*  •• 

5596.08 

3551*** 

KB 

;;::-:::;:;.;v.::;;5592.37- 

3.72 

ADA  Crewmember 

16R 

1,617 

615 

38.03 

8,768.50*** 

8,726.22 

42.29*** 

8,677.89 

48.32*** 

■■ 

8,671.12 

6.77 

Teletypewriter  Repatrer 

31J 

ilisw 

141 

30.65 

n 

1,676.75 

1,665.74 

U.01*** 

1,637.43 

2831** 

BB 

1,632.03 

5.40 

Parachute  Rigger 

43E 

954 

491 

51.47 

1 

6,409.57 

2 

6,377.90 

31.67*** 

3 

6,358.67 

19.24 

4 

6,351.30 

7.37 

Power  Generator 

52D 

487 

153 

31.42 

n 

1,835.97 

Repairer 

■s 

1,810.02 

25.95 

1,794.18 

15.84 

1,788.82 

5.36 

Nuclear  Weapons 

55G 

106 

32 

30.19 

I^B 

28535 

Specialist 

2 

293.84 

1.50 

3 

273.62 

10.23 

4 

265.18 

8.44 

/  Continued  / 
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Table  10 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(Category  IV)  (continued) 


ENLISTMENT  TERM  3,  continued 


Name 

MOS 

N 

#  of 
Events 

* 

Attrition 

1 

citi 

Sqoaare* 

Motor  Transport 

64C 

8,481 

2,546 

30.02 

mM 

45,140.23*** 

Operator 

44,732.76 

44,675.33 

57.43*** 

HI 

44,662.19 

13.16* 

Admin  Specialist 

iilii 

IMWil 

3052 

— 

8,349.37 

8,28159 

6738*** 

8,240.44 

4135*** 

8^235.05 

539 

Field  Artillery  Surveyor 

82C 

871 

315 

36.17 

mm 

4,121.43** 

4,079.46 

41.97*** 

4,062.04 

17.42 

4,056.96 

Food  Service  Specialist 

94B 

7,693 

3.336 

4336 

— 

57,88837*** 

■Mj 

IBI 

57,41231 

57,305.21 

57,29125 

Military  Police 

95B 

3,859 

1,082 

28.04 

H 

17,49837* 

17362.07 

136.20*** 

17,310.19 

51.88*** 

■■ 

17300.35 

9.85* 

ENLISTMENT  TERM  4 


Infantryman 

:  im 

6227 

1,926 

:  30:93; 

■ 

32,928.408 
32,908.744 
32,837.073 
32832.188  ; 

19.67*** 

71.67*** 

4.89 

Cannon  Crewmember 

13B 

3,682 

1,149 

31.21 

1 

18,437.423 

2 

18,427.681 

9.74** 

3 

18396.690 

30.99** 

4 

18,395.063 

1.63 

Pershing  Crewmember 

iilBiiii 

35.97 

— 

471.903 

471.604 

030 

458.442 

13.16 

■I 

454.123 

432 

/  Continued  / 
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Table  10 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(Category  FV)  (continued) 


ENLISTMENT  TERM  4,  continued 


Name 

MOS 

N 

#of 

Events 

% 

Attrition; 

Model 

-2  Log  L 

Chi 

Square* 

Vulcan  Repairer 

27F 

224 

100 

44.64 

wm 

1026.56 

1011.99 

14.60*** 

1007.90 

4.10 

1003.29 

4.60 

Teletypewriter  Repairer 

3U 

221 

80 

3620 

m 

827.73  - 

808.08 

19.65 

■ii 

791.79 

16.28 

781.12 

10.67 

Wire  Systems  Installer 

36C 

2,464 

845 

34.29 

1 

2 

147.77*** 

3 

12,669.60 

30.48** 

4 

12,651.64 

17.96** 

Parachute  Rigget 

43E 

103 

40 

38.83 

1 

347.03 

345.89 

1.13 

332.89 

13.00 

■■ 

|||||ll|||8i||||||^ 

429 

Water  Treatment 

51N 

505 

206 

40.79 

2,456.94 

Specialist 

2,414.35 

42.59*** 

2,395.61 

18.75 

2,393.48 

2.13 

Interior  Electrician 

99 

nn 

1,091.57 

L062.97 

28.60*** 

hbIH 

1,040.56 

22.42* 

mi 

1,03434 

621 

Water  Craft  Operator 

61B 

206 

102 

49.51 

1 

1,023.10 

2 

1,018.12 

4.99* 

3 

995.18 

22.94* 

4 

994.22 

0.97 

Motor  Transport 

64C 

120 

40 

33.33 

1 

365.57 

Operator 

2 

360.44 

5.13* 

3 

343.40 

17.04 

4 

335.84 

7.57 

Aircraft  Powerplant 

68B 

144 

36 

25.00 

— 

345.67 

Repairer 

330.35 

15.32*** 

181118318^8 

319.84 

1031 

HH 

301.03 

1832*** 

Traffic  Mgmt. 

71N 

117 

51 

43.59 

458.93 

Coordinator 

445.86 

13.07 

Hi 

42120 

2326 

■■ 

'  421.48 

0.41 

DF  =  N  of  variables  added  to  model;  ’  p-value  <  .05;  *’  p-value  <  .01;  ”*  p  -value  <  .001. 
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Table  11 


Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(Categories  IHB  &  IV) 

ENLISTMENT  TERM  3 


Name 

MOS 

N 

#  of 
Events 

% 

Attrition 

-2  L<^  L 

Cbi 

Square* 

Morse  Interceptor 

OSH 

135 

39 

28.89 

368.83 

366.99 

1.84 

348.82 

18.17 

■■ 

345.97 

2.85 

Infantryman 

IIB 

27,560 

{BBS 

46.05 

B 

252,135.20**^ 

251,251.15 

884.05*** 

11 

250,993.94 

25721*** 

— 

IH 

250,977.52 

16.42** 

Bridge  Crewmember 

12C 

2;274 

862 

37.91 

wm 

12,90833 

12,790.41 

117.93*** 

12,769.48 

20.93 

IKH 

12,768.02 

1.46 

Cannon  Crewmember 

iSi 

12,671 

5,353 

42.25 

98318.73*** 

1 

97,682.17 

63636**“* 

1 

97,587.63 

9434*** 

■1 

Mi 

97371J6 

15.87** 

Pershing  Crewmember 

15E 

1,393 

659 

47.31 

1 

9,14836** 

2 

9,114.66 

33.90*** 

3 

28.96** 

4 

3.25 

ADA  Crewmember 

ilBiii 

iiilliiil 

760 

39.65 

— 

11,08138*  *• 

11,029.88 

51.49*** 

10,972.69 

57.19*** 

Wi 

10,966.40 

629 

Teletypewriter  Repairer 

3U 

625 

185 

29.60 

m 

2,315.77 

2,2%.80 

18.98*** 

2,26735 

29.45** 

■■ 

2,264.68 

2.67 

Parachute  Rigger 

43E 

1,393 

730 

.  52.40 

10,073.20* 

•  . 

■  2 

10,048.88 

24.32*** 

.  3,,'  :  ■ 

10,031;76 

17.12-1 

1032338 

8;i8/;.;"-. 

Power  Generator 

52D 

953 

324 

34.00 

4,308.70* 

Repairer 

4,236.63 

72.08*** 

4,218.15 

18.47 

■■ 

4,214.67 

3.49 

Nuclear  Weapons 

55G 

175 

56 

32.00 

n 

551.90 

Specialist 

■HH 

550.85 

1.05 

534.47 

16.39 

527.08 

7.39 

/  Continued  / 
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Table  11 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(Categories  lllB  &  IV)  (continued) 


ENLISTMENT  TERM  3,  continued 


Name 

MOS 

N 

#of 

Events 

% 

Attrition 

Model 

-2  LogL 

Chi 

Sijaare* 

Water  Craft  Operator 

61B 

113 

47 

41^9 

1 

421.91 

2 

413.40 

8.51** 

3 

390.31 

23.09* 

4 

381.95 

835 

Motor  Transport 

64C 

11,618 

3,617 

31.13 

1 

66,349.41*** 

Operator 

2 

65,74237 

606.44*** 

65,678.50 

64.47*** 

4 

65,658.50 

20.00*** 

Admin  Specialist 

71L 

3,375 

1,043 

30.90 

1 

16,572.81 

2 

•  16,443.23 

129.58*** 

3 

16381.09 

62.14*** 

4 

16376.77 

4.32 

Field  Artillery  Surveyor 

8,13136 

8,05033 

8133*** 

3 

8,033.4? 

16.86 

4 

8,031.78 

1.70 

Food  Service  Specialist 

94B 

9,511 

4,169 

43.83 

1 

74,107.24*  •* 

2 

73,51837 

588.87*** 

3 

73396.66 

121.71*** 

4 

73,383.87 

12.79* 

Military  Police 

95B 

8,491 

2,371 

2732 

1 

42,079.23*** 

2 

41,698.83 

38039*** 

3 

41,631.07 

67.76*** 

4 

41,617.89 

1336* 

ENLISTMENT  TERM  4 


Morse  Interceptor 

OSH 

183 

50 

27.32 

1 

2 

3 

4 

505.49 

504.53 

480.99 

486.75 

0.96 

17.78 

5.76 

Infantryman 

9,706 

2,985 

3075 

53,688.38 

53,661.71 

26.67*** 

53,55439 

106.72*** 

4; 

53;54830 

6.79 

Cannon  Crewmember 

13B 

5,169 

1,641 

31.75 

1 

- - - 

27,436.53 

2  . 

27,424.02 

12.51*** 

3 

27,378.98 

45.04*** 

4 

27,377.20 

1.78 

/  Continued  / 
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Table  11 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(Categories  IIIB  &  IV)  (continued) 


ENLISTMENT  TERM  4,  Continued; 


Name 

MOS 

N 

#  of 
;  Events 

% 

Attiitifflt 

Model 

>2LogL 

Cht 

Square* 

Pershing  Crewmember 

15E 

213 

83 

38.97 

Bj 

850.18 

848.98 

1.2 

832.09 

16.89 

■1 

829.50  ■ 

239 

Vulcan  Repairer 

27F 

368 

1551 

43.21 

n 

1,794.27 

IH 

1,774^ 

19.99*  ** 

1,764.76 

9.52 

■■ 

1,758.45 

6.32 

Teletypewriter  Repairer 

3U 

306 

119 

38.89 

B 

1308.58 

1382.88 

25.70*** 

1,268.22 

14.66 

■■ 

1,257.79 

10.43* 

Wire  Systems  InstaUer  • 

36C 

3,201 

1,098 

34J6 

n 

17,26734 

17,062.34 

205.00*** 

17,02033 

42.06*** 

16,995.68 

24.66*** 

Parachute  Rigger 

43E 

160 

67 

41.87 

B 

641.03 

638.83 

2.20 

618.01 

20.82 

MM 

612.68 

5.33 

Water  Treatment 

51N 

liiliiil 

liiiipl 

40.23 

— 

3,49331 

Specialist 

3,44539 

48.02*** 

. 

3,427.68 

17.61 

3,422.47 

530 

Interior  Electrician 

51R 

509 

165 

32.42 

1 

1,988.16 

2 

1,934.64 

53.51*** 

3 

1,918.88 

15.77 

4 

1,915.69 

3.18 

Water  Craft  Operator 

61B 

245 

114 

46.53 

1 

1,188.43 

2 

1,178.81 

9.62** 

3 

1,14833 

30.68** 

4 

1,14634 

1.19 

Motor  Transport 

64C 

151 

53 

35.10 

B 

507.83 

Operator 

mM 

497.19 

10.64** 

481.35 

15.84 

■1 

478.41 

2.95 

/  Continued  / 
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Table  11 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(Categories  IHB  &  IV)  (Continued) 


enlistment  term  4,  Continued 


DF  =  N  of  variables  added  to  model; 


p-value  <  .05; 


p-value  <  .01; 


***  p  -value  <  .001. 


Table  12 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 

(All  Categories) 


ENLISTMENT  TERM  3 


NdmB 

• 

MOS 

N 

#of 

Events 

% 

Model 

>2LogL  - 

Cht 

Square* 

Morse  Interceptor 

OSH 

453 

122 

26.93 

1,450.23 

1,428.63 

2147*** 

1,421.98 

6.68 

1,414.12 

7.86 

Infantryman 

IItIbP 

iliiSii 

m 

312,099.32*** 

310,828.73 

.  -14704*** 

*310,53834 

29049*** 

310,521^1 

16.83** 

Bridge  Crewmember 

12C 

2,933 

1,092 

37.23 

16,914.99* 

16,759.41 

155.58*** 

16,740.59 

18.82 

16,739.77 

0.82 

Cannon  Crewmember 

iliil 

iiHiWl 

6,123 

iilRii 

114,107.29*** 

11335610 

751,19^** 

11331.99 

94.11*** 

■Bi 

113,247.17 

14.82** 

Pershing  Crewmember 

ISE 

1,800 

853 

47.39 

mm 

12,279.00 

■  12,231.66 

47.34*** 

12,199.30 

3246** 

■■ 

12,194.17 

5.13 

ADA  Crewmember 

;  VSR 

liiiiii 

liillM 

39.44 

12,656.98** 

3248233 

74.66*** 

12,519.55 

62.78*** 

— 

12409.95 

9.60* 

Teletypewriter  Repairer 

31J 

807 

237 

29.37 

1 

2 

41.96*** 

3 

36.51*** 

4 

3.19 

Parachute  Rigger 

43E 

1,828 

ItlliQiii 

n 

13,34129* 

Hii 

13404.24 

37.95** 

IHl 

13484.24 

20.09 

■M 

13475.84 

8.40 

Power  Generator 

52D 

1,556 

505 

32.46 

H 

7423.40 

Repairer 

7,108.27 

7,078.22 

7,077.54 

0.67 

/  Continued  / 
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Table  12 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(All  Categories)  (Continued) 


ENLISTMENT  TERM  3,  continued; 


Name 

MOS 

N 

#of 

Events 

% 

Attrition 

Model 

•2  Log  L 

Chi 

Square* 

Nuclear  Weapons 

55G 

360 

96 

26.67 

mm 

1,092.61 

■■lllll 

Specialist 

■  1,090.87 

1,066.11 

Hi 

1,058.28 

Watercraft  Operator 

6iB 

144 

54 

3750 

IliM 

510.41 

49734 

13-06*** 

47194 

24.40* 

463.98 

8.96 

Motor  Transport 

64C 

14,612 

4,533 

31.02 

1 

85,254.82 

Operator 

2 

•  84,44450 

810.32*** 

3 

84363.23 

81.27*** 

4 

84,346.41 

16.82** 

Admin  Specialist 

1,66S1 

- 

— 

||iM 

2730533 

228.72*** 

27,835.88 

69.46*** 

BH 

27,831.83 

4.05 

Field  Artillery  Surveyor 

82C 

2,465 

873 

35.42 

■■ 

13,251.85** 

13,137.07 

114.78*** 

13,112.60 

24.46* 

KH 

13,110.88 

1.73 

Food  Service  Specialist 

94B 

10,964 

4,702 

42.89 

HI 

84,99633** 

84,273.76 

72258*** 

84,129.^ 

143.96*** 

BH 

84415.aZ 

14.78** 

Military  Police 

95B 

18,561 

4,578 

24.66 

H 

88,417.54*** 

87,673.46 

87,481.14 

192.32*** 

Hi 

87,461.96 

19.19*** 

ENLISTMENT  TERM  4 


Morse  Interceptor 

OSH 

744 

165 

2132 

1 

2 

3 

4 

2,049.18 

2,144.01 

2,120.40 

2,115.02 

5.06* 

23.61* 

537 

Infantryman 

imi 

90,781.69*** 

' 

90,75553 

26.16*** 

■mm 

90,507.12 

248.42*** 

■■ 

90,499.00 

8.12 

/  Continued  / 
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Table  12 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(All  Categories)  (Continued) 


ENLISTMENT  TERM  4,  continued: 


Name 

;  MOS 

N 

#of 

Events 

% 

Attrition 

>2LogL 

Chi 

Square* 

Cannon  Crewmember 

13B 

6,800 

2,159 

31.75 

mm 

37,273.14 

37253.16 

19.98*** 

37,175.15 

KB 

37,17337 

1.79 

Pershing  Crewmember 

15E 

338 

138 

4QS3 

n 

1,537.11 

1,53524 

1.88 

1,519.93 

1531 

1,517,44 

2.49 

Vulcan  Repairer 

27F 

589 

235 

39.90 

— 

2,883.61 

2,84627 

3735*** 

12.66 

■Bi 

2.44 

Teletypewriter  Repairer 

iiSll 

417 

152 

36.45 

1,767.63 

1,732.17 

35,^*** 

1,72221 

9.93 

1,716^ 

533 

Wire  Systems  Installer 

36C 

3,800 

1,302 

34.26 

mm 

20,921.22 

20,680.92 

240.30*  •• 

20,634.60 

4632*** 

BH 

20,61334 

21.06*** 

Parachute  Rigger 

B 

273 

110 

4029 

1,17237 

2.77 

11 

l^n 

4  81 

Water  Treatment 

51N 

826 

327 

3959 

1 

4,226.84 

Specialist 

2 

4,173.80 

53.04*** 

3 

4,160.59 

13.21 

4 

4,157.50 

3.08 

Interior  Electrician 

51R 

803 

238 

29.64 

1 

3,087.22*** 

2 

3,012.35 

74.87*** 

3 

2,998.95 

13.40 

4 

2,995.99 

2.96 

Water  Craft  Operator 

61B 

289 

134 

4637 

n 

1,439.88 

1,428.77 

11.11*** 

1,404.17 

24.60* 

1,40031 

3.65 

/  Continued  / 
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Table  12 

Summary  and  Specified  Model  Results  for  Attrition  by  MOS 
(All  Categories)  (Continued) 


ENLISTMENT  TERM  4,  continued: 


Nawe 

MOS 

N 

#of 

Events 

% 

Attrltioo 

i  Model 

^LogL 

Chi 

Square* 

Motor  Transport 

64C 

197 

72 

36.55 

1 

72531 

Operator 

2 

709.96 

15.41*** 

3 

691.72 

18.24 

4 

689.24 

2.48 

Aitcraft  Powcfplant 

68B 

460 

110 

23.91 

1 

1,314.83 

i;276T4 

38.69^** 

1,26050 

15.64^ ' 

lily 

1,255.73 

4.77" 

Traffic  Mgmt. 

71N 

302 

129 

42.72 

1,405.12 

Coordinator 

1386.13 

18.99*** 

1359.44 

26.68** 

1,358.40 

1.04 

Computer/Machine 

iiiii 

iiliiiili 

iili® 

— 

1,03339*** 

Operator 

mil 

1,00839 

2430*'** 

989.07 

19.82 

98539 

3.G& 

Still  Photographic 

84B 

262 

78 

29.77 

H 

834.15** 

Specialist 

802.11 

32.05** 

781.26 

20.85 

■1 

775.15 

6.12 

Food  Service  Specialist 

94B 

137 

52 

37.96 

n 

482.74 

467.86 

14.88'**  ■ 

HI 

439.95  - 

2731** 

mOi 

436.03 

3.92 

Military  Police 

95B 

382 

120 

31.41 

■■ 

18.70*** 

531 

6.60 

*  DF  =  N  of  variables  added  to  model. 


*  p- value  <  .05  **  p- value  <  .01  ***  p- value  <  .001 
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Best  Models.  Table  13  shows  the  best  models  by  MOS  and  TOE  for  all  soldiers,  ■ 
Category  IIIB  and  IV,  and  Category  FV  soldiers  alone  where  the  N  was  sufficiently  large 
(>  100).  Of  the  27  analyses  run  for  Category  IV  MOSATOE  groups,  25  resulted  in  a  best 
model  with  significant  fit  to  the  data;  33  (of  34)  were  found  for  CAT  IIIBs  and  IVs, 
while  32  (of  34)  were  obtained  when  aU  soldiers  with  complete  data  were  included  in  the 
analyses. 

It  should  come  as  no  surprise  that  high  school  graduation  status  was  included  in 
the  best  models  far  more  often  than  any  other  predictor-about  90%  of  the  time 
(Table  14).  Other  variables  that  emerged  with  some  frequency  include  the  spatial 
perception,  attention  to  detail,  and  numerical  operations  subtests,  as  well  as  age  and 
dependent  status.  For  the  ASVAB  subtests,  the  direction  of  the  relationship  was  as 
expected,  with  higher  scorers  less  likely  to  leave  service  before  completing  their  term. 
Dependent  status  was  also  positively  related  to  attrition;  if  one  had  dependents,  one  was 
more  likely  to  complete  the  first  term.  Somewhat  surprising  was  the  mixed  bag 
concerning  age;  in  5  instances  the  results  indicated  that  older  soldiers  were  less  likely  to 
leave  service  prematurely.  However  in  the  19  other  cases  where  age  was  included  in  the 
best  model,  the  opposite  was  true.  There  is  no  apparent  pattern  to  these  results  that 
would  serve  to  explain  this  variation. 

Because  of  the  mixed  results  concerning  age  and  the  possible  controversy  in  using 
dependent  status  as  a  selection  variable,  a  global  best  model  was  tested  using  high  school 
graduation  status,  NO,  AD,  and  SP  scores.  The  predictive  power  of  this  model  was 
tested  by  applying  it  to  the  data  pooled  across  MOS  with  all  recruits.  Category  IIIB  plus 
IVs,  and  Category  IVs  only. 

As  seen  in  Table  15,  HS  was  significantly  related  to  attrition  in  all  cases.  Further, 
the  addition  of  each  subsequent  variable  resulted  in  significant  increases  in  fit  across 
aptitude  groups.  The  smallest  increase  was  that  achieved  when  SP  was  added  to  the 
model  for  Category  IVs  with  4-year  TOE,  however  even  this  was  marginally  significant. 


Table  13 

"Best  Models"  for  Predicting  Attrition  by  MOS 
and  Term  of  Enlistment  (TOE) 


MOS 

TOE 

AFQT 

Category 

N 

-2  Lag  L 

Chi  Square” 

BEST  MODEL 
Variables 

OSH 

3 

ALL 

453 

24.6 

HS 

IBB  &  rv 

135 

No  significant  model 

mm 

ALL 

774 

252 

HS  GS  AI<^>  CC 

iiiB&rv 

183 

82 

AI  {+) 

llB 

3 

, 

ALL 

34,056 

1592.7 

HS  GS  SP  SI(+)  GI  AD  NO 
AGE  NODEP  BMASSi^)  CA 

' 

niB  &IV 

27,560 

US74 

HS  GS  SP  SL^'l  AD  NO 

AGE  NODEP  BMASSi+t  CA 

' 

IV 

20,434 

99L1 

HSSPAIt^}  AD  NO  AGE 
NODEP  BMASSv+t  CA 

4 

Illillllilii 

.  2952 

AFQT  HS  MC  SP  AL+)  Sl<>) 

GI  AGEt+)  NODEP 

IBB  &rv 

llllillillplll 

HSMCSI(+)  AGE(*) 

NODEP 

w 

6,227  . 

76.4 

HS  MC  SIi+i  El  AD  AGE(+.) 

12C 

3 

ALL 

2,933 

165.9 

HS  NODEP 

niB  &  IV 

2,274 

126.0 

HS  NODEP 

IV 

1450 

76.6 

HS 

;  13B 

3 

ALL 

14,455 

851.8 

HS  MC  SI(^-)  AD  NODEP 
BMASSt+) 

niB&rV 

12,671 

793.2 

HS  MC  SP  Sl{*)  AD 
NODEPCCtt)., 

IV 

9,894 

646.0 

HS  SI{+)  AD  NODEp  :CC(f) 

4 

ALL 

6,800 

80.0 

HS  AD  AGE(+)  NODEP 

IIIB&IV 

5,169 

382 

HS  AGEi'f) 

IV 

3,682 

28.2 

HS  AD  AGE(+) 

62 
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Table  13 

'Best  Models”  for  Predicting  Attrition  by  MOS  and  Term  of  Enlistment  (TOE) 

(Continued) 


MOS 

lilil 

AFQfr 

Category 

N 

*2  ItOJE  Xi 

Oil  Square 

BEST  MODEL 
Variables 

15E 

3 

ALL 

1,800 

68.1 

HS  AD(+)  AGE(+) 

lUB  &  IV 

1,393 

58.9 

HS  AD  AGE(+) 

IV 

946 

53.8 

HS  AD 

4 

ALL 

338 

No  significant  model  || 

lUB&rv 

213 

11.1 

NODEP 

IV 

139 

6.9 

AD  NODEP 

16R 

3 

ALL 

2,160 

125.6 

AFQTf)  HS  MC  NO  CM^+^ 

uiB&rv 

1,917 

109.S 

AFQTi+l  HS  NO 

liiilliiiS 

93.5 

AFQTf+^HSNO 

27F 

4 

ALL 

589 

38.4 

HS 

lire  &  IV 

368 

20.8 

HS 

IV 

224 

20.7 

HS  CC{+) 

3U 

lllIl 

ALL 

807 

603 

H$HOA<5Em 

mB&iv 

625 

27.6 

H$NO 

IV 

460 

2L1 

HSNO 

llliRiilP! 

35.1 

HS 

IIIB&IV 

.H&CEt^V  ..  ..  .  .. 

221 

:  HS  GS  GE(+-)' 

36C 

4 

ALL 

3,800 

279.4 

HS  NO  AGEi^^)  CA 

IIIB  &  IV 

3,201 

249.9 

HS  SP  NO  NODEP  CA 

IV 

2,464 

173.2 

HS  NO  AGE 

43E 

lilil! 

ALL 

1,828 

55.4 

HS  NO  NODEP 

BIB  &  iV 

133 

32L8 

HS  NODEP 

TV 

954 

40.7 

HS  NODEP 

4 

ALL 

273 

43 

NO 

BIB  &  IV 

160 

15.77 

AI(+>NO 

IV 

103 

103 

NO 

63 
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Table  13 

"Best  Models"  for  Predicting  Attrition  by  MOS  and  Term  of  Enlistment  (TOE) 

(Continued) 


MOS 

TOE 

wm 

■Ml 

"  .2LogL 

Chi  Square 

BEST  MODEL 

Varmbles 

51N 

ALL 

826 

54.1 

HS 

niB  &  rv 

691 

55.8 

HS  CA 

rv 

505 

48.9 

HS  NODEP 

B 

B 

ALL 

SOS 

81.4 

HS 

m 

IIEB  &  IV 

509 

54.9 

HS 

1 

m 

xv 

SOS 

38.1 

H$  GI 

ALL 

1^56 

B53 

HS  SP  AI 

mB  &  rv 

953 

77.0 

AFQT(+)  HS 

IV 

487 

33.1 

HS  SP 

55G 

ALL 

360 

95 

SP  ' 

inB&iv 

175 

12.7 

AFQTw  NO  AGEi*) 

IV 

95 

NO  age^^J  CA 

61B 

ALL 

144 

21.0 

HSNO 

inB  &  IV 

ID 

25.8 

HS  GS  EI(+)  NO  CE 

4 

ALL 

289 

15.6 

Hsm 

mB  &  rv 

245 

15.6 

HS  GS  SP  SI(+)  GI  NO 

IV 

206 

13.8 

HS  GS  SP  ■ 

64C 

:> 

ALL 

14,612 

878.8 

HS  SP  AI(-)  NO  NODEP 
BMASS(+) 

niB  &1V 

11,618 

681-0 

HS  SP  AI(+)  AD  NODEP 

CA 

IV 

8,481 

4545 

HS  Alf'^)  AD  NODEP 

4 

ALL 

197 

293 

HS  AD  NOn-)  AGEtn 

mB  &1V 

151 

18-8 

HSSPAD 

rv 

120 

7-2 

68B 

4 

ALL 

460 

393 

HS 

niB  &  IV 

249 

22.5 

HS 

IV 

144 

32.1 

HS  CC(+)  CE(.-) 

64 
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Table  13 

"Best  Models"  for  Predicting  Attrition  by  MOS  and  Term  of  Enlistment  (TOE) 

(Continued) 


MOS 

TOE 

AFQX 

Category 

N 

-ZLogL 

Old  Square* 

BEST  MODEL 

Vaiialdes 

71L 

3 

ALL 

5,476 

296.2 

HS  SP(+)  AD  AGE(+) 

inB  &  IV 

3375 

1883 

AFQT  HS  SP  AD  AGE(+) 

IV 

1,840 

97.4 

HS  AD  AGE(+) 

71N 

4 

ALL 

302 

29,2 

HS  BMASSi+i 

IIIB&IV 

195 

353 

HS  AGE{+)  BMASS(+) 

IV 

117 

20,6 

HS  AGEi+j 

74D 

4 

ALL 

310 

46.8 

HSGI 

IBB  &  rv 

145 

44.1 

HS  El  GI  AD 

82C 

3 

2,465 

131.7 

HSSF 

inB&iv 

13I6 

8L4 

^ 

IV 

871 

45.1 

HS 

84B 

■ 

ALL 

262 

44.2 

HS  CC 

IIIB  &  IV 

120 

162 

HS 

94B 

1 

ALL 

10,964 

857,9 

HS  SP  AD  NO  BMASS<+) 

mB&IV 

9311 

714.0 

HS  SP  AD  NO  BMASS^^j 

TV 

7,693 

6043 

HS  SP  AD  NO  BMAS^+) 

■ 

ALL 

HSADNO 

IIIB  &  IV 

no 

'  "28:4  i:y 

HS  AD  NO  AGE 

95B 

3 

ALL 

18,561 

1151.0 

HS  MC  GI  AGE(-)  NODE? 
CACC 

IBB  &  IV 

8,491 

450.0 

HS  GI  AGE(+)  NODEP 

IV 

3,859 

163.8 

HS  GI  NODEP 

■ 

ALL 

382 

212 

HS 

BIB  &  IV 

173 

,21.3 

HS  MC 

“  Chi  Square  DF  5=  number  of  variables  in  model,  p-levels:  .01  if  N  >  300;  .05  if  j<_  LE  300. 
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Table  14 

Frequency  of  Variable  Significance  in  Predicting  Attrition 
by  AFQT  Category 


Category  IV 

Category  IHB&rV 

AU 

Predictor 

(27  models) 

(34  models) 

<34  models) 

HS 

23 

29 

25 

AFQT 

1 

3 

2 

GS 

2 

1 

2 

MC 

1 

3 

4 

SP 

4 

8 

8 

A1 

2 

3 

4 

SI 

2 

3 

3 

El 

1 

1 

1 

GI 

2 

2 

3 

AD 

9 

9 

7 

NO 

7 

8 

9 

AGE 

6 

9 

9 

DEP 

7 

9 

8 

BMASS 

2 

3 

5 

CA 

3 

4 

3 

CC 

4 

1 

2 

CE 

2 

1 

0 

GM 

0 

0 

1 

Table  15 

Model  Fit/Incremental  Fit  of  "Best"  Models^ 
with  Attrition  Criteria 


AFQT 

Category  . 

TOE 

r? . 

#of 

Events 

%  ^Jtritlon 

Model 

^ . 

-2LogL  ■ 

CM 

Square** 

ALL 

4 

33,885 

10,572 

31.20 

■■ 

215,754.91*** 

215,687.47 

67.44*** 

mm 

215,666.60 

20.8r** 

215,622.69 

43.91*“ 

niB  &  IV 

■I 

22,185 

7,256 

32.71 

141,809.84*** 

141,786,22 

.  ‘23.62*** 

IM 

141,769.78 

16.44“* 

141,75310 

16.68*** 

rv 

w 

15,021 

4,933 

32.84 

n 

92,521.80*** 

92,493.66 

28.14“* 

mM 

92,473.32 

20.34*“ 

Kl 

92,464.85 

8.4r 

3 

113^ 

42,718 

37.73 

n 

967,020.46*** 

966,630.63 

38933*** 

966,580.75 

49.88*** 

966,388.84 

191.91*** 

IBB  &  IV 

3 

83,986 

33,557 

39.95 

n 

739,676.96*** 

mm 

739,487.07 

189.89“* 

mm 

739,425.08 

61.99*** 

■■ 

739,340.57 

84.51*“ 

IV 

3 

59,509 

23,708 

39.84 

1 

506,364.75*** 

2 

506,210.70 

154.05*** 

3 

.  506,156.23 

54.46*“ 

4 

506,094.45 

61.78*“ 

“  Model  1  =  HS;  Model  2  =  HS,  NO;  Model  3  =  HS.  NO,  AD;  Model  4  =  HS.  NO,  AD,  SP. 
DF  =  1. 


Clearly,  the  very  large  number  of  cases  in  these  analyses  increased  the  likelihood 
that  significant  results  would  be  found.  To  further  test  the  applicability  of  our 
generalized  model,  therefore,  it  was  applied  within  selected  MOS.  These  were  selected 
to  represent  varying  levels  of  utility  for  low-aptitude  soldiers  as  described  previously. 
Table  16  presents  these  results,  which  tend  to  confirm  the  suggestion  presented  earlier. 
That  is,  that  the  strength  of  the  relationship  between  high  school  graduation  status  and 
attrition  is  such  that  other  variables  add  very  little  to  our  predictive  ability.  In  fact,  of  the 
nine  MOS  included  in  these  analyses,  HS  was  significantly  related  to  attrition  for  lower- 
aptitude  personnel  in  all  but  one  (15E).  The  addition  of  NO,  AD,  and  SP,  however, 
resulted  in  significant  incremental  validity  in  only  two  MOS  (IIB  and  71L). 

In  sum,  then,  it  appears  that  although  there  were  other  variables  that  made  some 
contribution  to  our  ability  to  predict  first-term  pejorative  attrition,  the  only  consistent 
result  was  one  we  have  known  all  along.  High  school  graduates,  whatever  their  aptitude 
level,  were  less  likely  to  leave  service  prematurely  then  were  nongraduates.  The 
instability  in  the  remainder  of  the  findings  yields  little  information  that  will  allow  us  to 
refine  the  selection  process  among  lower-aptitude  personnel  so  as  to  reduce  further  the 
incidence  of  attrition. 

Fairness.  Though  high  school  graduation  status  has  been  used  explicitly  as  a 
predictor  for  decades,  particularly  for  below-average  personnel.  Table  17  provides  a  rare 
glimpse  of  its  fairness  (along  with  the  lesser  weighted  NO,  AD,  and  SP  ASVAB  subtests) 
for  below-average  white  and  black  soldiers  accessed  during  the  misnorming.  Generally, 
blacks  were  somewhat  less  likely  than  whites  to  be  "excluded"  at  the  various  simulated 
cutting  score  levels.  This  finding  coincides  with  the  lower  attrition  rates  for  excluded 
blacks  than  for  excluded  whites.  In  fact,  there  was  evidence  of  a  degree  of 
underprediction  for  blacks  which  is  in  keeping  vrith  the  literature  shovring  lower  attrition 
and  less  validity  of  attrition  screens  for  blacks  (cf.  Binkin  &  Eitelberg,  1982;  Trent,  1993). 
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Table  16 

Model  Fit/Incremental  Fit  of  "Best"  Models® 
for  Attrition  by  Selected  MOS 


MOS 

AFQX 

Category 

N 

Events 

% 

Attrition 

Model 

-2LogL‘' 

Chi 

S<|iialre 

IIB 

3 

ALL 

34,056 

15,372 

45.14 

1 

310,862.80'** 

2 

310,766.47  ‘ 

9634*** 

3 

310,756.65 

9.82** 

4 

310,709.06 

47.58*** 

niB  &  IV 

27,560 

12,691 

46.05 

1 

251,25121*** 

. 

2 

251,197.51 

53.70*** 

3  • 

251,180.02 

17.48*** 

4 

251,150.06 

29.97*** 

IV 

20,434 

9,281 

45.42 

1 

178,18337*** 

2 

178,130.00 

533r** 

3 

178,110.91 

19.09*** 

4 

178,08734 

2337*** 

12C 

B-Si 

iililiilS: 

2,933 

1,092 

37.23 

1 

16,760.79*** 

2 

16,760.62 

36 

3 

16,75732 

331 

16,75725 

.27 

mB&rv 

2,274 

862 

37.91 

1 

12,791.20*** 

2 

12,790.94 

.26 

3 

22,78921 

1.73 

12,789.12 

.09 

IV 

1,550 

574 

37.03 

IMii 

8,089.70*** 

2 

8,089.43 

.27 

3 

8,089.13 

.30 

4 

8,088.35 

.78 

15E 

4 

ALL 

338 

138 

40.83 

1 

1,535.34 

2 

1,535.32 

.02 

3 

1,532.95 

236 

4 

1,532.94 

.01 

IHB  &  IV 

213 

83 

38.97 

1 

849.84 

2 

849.77 

.07 

3 

848.82 

.95 

4 

848.80 

.02 

rv 

139 

50 

35.97 

1 

472.12 

2 

472.12 

.00 

3 

467.78 

4.34* 

4 

467.12 

.66 

/  Continued  / 
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Table  16 

Model  Fit/Incremental  Fit  of  "Best"  Models 
for  Attrition  by  Selected  MOS  (Continued) 


Chi 

Square 


#of 

Evetkls 


Attritieu  |  Model 


2,846.9^ 

2,846^ 

2,846^ 

2,843.26 

l,774m‘ 

1,774.81 

1,774.65 

1,773.08 


65,743.71 

65,737.76 

65,731.89 

65,724.70 

44,B2.80‘ 

44,72631 

44,720.42 

44,71637 


29.64 


51R 


32.42 


niB  &  IV 


32.67 


84,445.39*" 

84,433-81 

84,425.99 

84,418.77 


31.02 


4,533 


14,612 


ALL 


64C 


2.10 

.05 

1.70 


2.05 

.04 

.71 


.83 

1.81 

.02 


/  Continued  / 
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Table  16 

Model  Fit/Incremental  Fit  of  "Best"  Models 
for  Attrition  by  Selected  MOS  (Continued) 


MOS 

llllll 

Category 

N 

m 

% 

Model 

-2LogL 

Chi 

Square 

64C 

4 

ALL 

197 

72 

36.55 

mm 

71035*“ 

710.02 

32 

701.16 

8.86“ 

699.15  ■ 

2.01 

me  &  IV 

151 

53 

35.10 

n 

49731*” 

497.19 

.12 

491.30 

5.88* 

487.95 

3.35 

IV 

120 

40 

3333 

H 

36039* 

360.47 

.11 

356.13 

434* 

KB 

354.46 

1.67 

7IL 

3 

ALL 

5,476 

1,669 

30.48 

27,908.60"* 

27,896.21 

1239*" 

27,88335 

12.86" 

27,87032 

1333" 

UIB&IV 

3,375 

1,043 

30.90 

mm 

16,443.99*** 

16,43733 

6.66** 

16,421.01 

•  1623"" 

16,415.16 

534* 

iiiiliiii 

30.92 

iS 

8,283.14“* 

8,28291 

,23 

8,267.51 

15.40*** 

8,263.09 

4,42* 

95B 

3 

ALL 

18,561 

4,578 

24.66 

87,739.50*** 

87,726.15 

13.35*** 

87,726.01 

.13 

KH 

87,700.69 

25.32*** 

IIIB  &  IV 

8,491 

2,371 

27.92 

H 

41,703.93*** 

41,703.26 

.66 

41,703.19 

.08 

HI 

41,701.02 

2.17 

IV 

3,859 

1,082 

28.04 

H 

17,365.49*“ 

17,361.72 

3.77 

17,36133 

.39 

17,357.65 

3.68 

“  Model  1  =  HS;  Model  2  =  HS,  NO;  Model  3  =  HS,  NO,  AD;  Model  4  =  HS,  NO.  AD,  SP. 
DF  =  1. 
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Table  17 


Percentages  of  White  and  Black  AFQT  Category  lilB  &  IV  Male  Soldiers 
Excluded  and  Attrition  Rates  for  Those  Excluded  at  Various  Best  Attrition 
Model  Cutting  Score  Levels  by  Term  of  Enlistment 


Cutting 

Score 

Levels 

Term  of  Enlistment  3 

Term  of  Enlistment  4 

%  Excluded 

%  Attrition 

%  Excluded 

%  Attrition 

White 

Black 

White 

Black 

White 

Black 

White 

Black 

95 

95.0 

94.9 

463 

33.0 

93.6 

963 

393 

28.3 

90 

90.5 

89.2 

47.4 

33.9 

87.7 

92.0 

39.9 

283 

85 

86.4 

82.8 

48.4 

343 

82.1 

873 

403 

28.6 

80 

82.4 

76.0 

493 

36.0 

76.7 

82.7 

41.1 

28.9 

75 

69.0 

50.4 

373 

713 

77.9 

41.9 

29.2 

Total 

N 

49^73 

30325 

9342 

11399 

%  HSDG 

32.0 

553 

81.4 

88.7 

Promotion 


Survival  Analyses.  As  with  attrition,  analyses  were  limited  to  subgroups  with  at 
least  100  members.  In  this  case,  another  characteristic  examined  was  Entry  Grade  (EG). 
Under  the  aegis  of  a  number  of  programs  in  operation  at  the  time,  individuals  were 
allowed  to  enlist  at  grades  higher  than  E-1  based  on  relevant  prior  experience  and/or 
education.  Obviously  this  must  be  controlled  for  when  examining  time  to  achieve  E-4, 
and  therefore  was  included  in  the  definition  of  adequate  cell  sizes  as  follows:  Only  those 
EGs  with  100  or  more  soldiers  were  included,  and  EG  was  entered  as  a  covariate  in  the 
analysis  if  there  were  two  or  more  grades  meeting  this  criterion.  Table  18  summarizes 
the  results  when  these  criteria  were  applied. 


Table  18 

MOS/Term  of  Enlistment  (TOE)/Entry  Grade  (EG) 
Categories  Meeting  Size  Requirements  for  AFQT  Groupings 


MOS 

TOE 

li^H 

Category  IV 

111  &  IV 

Categories 

i-iy 

OSH 

4 

1 

* 

120 

531 

IIB 

3 

1 

13,301 

18,068 

22,236 

IIB 

3 

2 

389 

523 

696 

IIB 

3 

3 

116 

134 

252 

IIB 

4 

1 

3,184 

5,768 

9,081 

IIB 

4 

2 

397 

644 

1,094 

IIB 

4 

3 

143 

247 

683 

12C 

3 

1 

904 

1,339 

1,674 

13B 

3 

1 

6,610 

8,396 

9,336 

13B 

3 

2 

236 

295 

322 

13B 

4 

1 

2,308 

3,182 

4,053 

13B 

4 

2 

239 

346 

436 

DB 

4 

3 

100 

141 

213 

15E 

3 

1 

612 

886 

1,136 

15E 

4 

1 

107 

156 

230 

/  Continued  / 
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Table  18 

MOS/Tenn  of  Enlistment  (TOE)/Entry  Grade  (EG) 

Categories  Meeting  Size  Requirements  for  AFQT  Groupings  (continued) 
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In  comparing  Categories  I-IIIB  with  IV,  23  MOS  x  TOE  cells  provided  sufficient  ■ 
numbers  of  cases.  Of  these,  9  had  multiple  entry  grades  with  more  than  100  soldiers.  (In 
the  remaining  14  instances,  only  starting  grade  E-1  had  sufficient  cases.)  Of  the  23 
analyses  conducted,  6  yielded  significant  differences  between  the  hazard  functions  for  the 
two  aptitude  groups.  These  are  presented  graphically  in  Figures  14  through  20. 

Keeping  in  mind  that  for  the  present  purposes  promotion  prior  to  12  months  in 
Service  was  considered  to  be  unrelated  to  performance  and  therefore  not  counted,  the 
first  notable  peak  of  promotion  to  E-4  was  at  15  months  across  MOS/TOE.  Thereafter, 
there  was  a  cyclical  pattern  of  peaks  every  three  months,  with  the  highest  incidence 
occurring  at  two  years.  The  differences  between  I-IIIBs  and  IVs  tended  to  favor  the 
former,  particularly  in  the  earlier  time  intervals.  When  Category  IV  promotion  did 
exceed  I-IIIBs,  it  was  uniformly  at  or  beyond  the  two-year  mark.  High  school  status  was 
a  significant  covariate  in  five  of  the  six  cases.  The  one  exception  was  13B,  4-year  TOE, 
where  there  were  only  three  percent  nongraduates.  Entry  grade  was  a  significant 
covariate  in  all  cases. 

Much  the  same  results  were  found  when  Category  I-IIIAs  were  compared  to 
Categories  IIIB  and  IV.  In  this  case  27  analyses  were  conducted,  with  enlistment  grade 
as  a  covariate  9  times.  A  total  of  8  significant  differences  were  found,  6  being  the  same 
as  discovered  previously  (Figures  21-28).  Only  in  the  case  of  MOS  12C  and  13B,  three 
year  TOE,  did  the  shift  of  Category  IIIBs  to  the  lower-aptitude  group  result  in  a  change 
in  outcomes.  In  both  cases  the  patterns  seen  earlier  were  repeated,  although  the  IIIB-IV 
group  appeared  to  be  better  off  as  Cannon  Crewmen  in  terms  of  being  promoted  earlier 
in  their  term  of  enlistment.  The  pattern  of  significance  in  the  covariates  was  the  same  as 
described  for  the  I-IIIB/IV  comparisons. 

Thus,  as  might  be  expected,  where  there  were  significant  differences  in  time-to- 
promotion,  brighter  individuals  were  promoted  to  E-4  with  greater  frequency  earlier  in 
their  terms  of  enlistment.  This  result  supports  earlier  work  that  indicates  that  lower 
aptitude  individuals  can  reach  the  same  level  of  proficiency  as  those  of  higher  aptitude, 
but  that  more  time  is  often  needed  to  do  so  (Vineberg,  Sticht,  Taylor,  &  Caylor,  1971). 
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4.  Hazard  Function  Comparisons  —  Promotion 
IIB,  3YR  TOE,  I-niB  vs.  IV 


Figure  15.  Hazard  Function  Comparisons  —  Promotion 
IIB,  4YR  TOE,  I-mB  vs.  IV 


Figure  16.  Hazard  Function  Comparisons  ~  Promotion 
13B,  4YR  TOE,  I-IHB  vs.  IV 


Figure  17.  Hazard  Function  Comparisons  —  Promotion 
71L,  3YR  TOE,  I-IHB  vs.  IV 
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8.  Hazard  Function  Comparisons  -  Promotion 
94B,  3YR  TOE,  I-mB  vs.  IV 


Figure  19.  Hazard  Function  Comparisons  —  Promotion 
95B,  3YR  TOE,  I-mB  vs.  IV 
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Figure  20.  Hazard  Function  Comparisons  —  Promodon 
1  IB,  SYR  TO^  i-niA  vs.  um/iv 


Hgure  21.  Hazard  Function  Comparisons  ~  Promotion 
1  IB,  4YR  TOE,  I-mA  vs.  IIIB/IV 
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Figure  22.  Hazard  Function  Comparisons  —  Promotion 
12C,  3YR  TOE,  I-mA  vs.  JUB/rV 


Figure  23.  Hazard  Function  Comparisons  ~  Promotion 
13B,  3YR  TOE,  I-mA  vs.  niB/IV 
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Figure  24.  Hazard  Funcnon  Comparisons  -  Promodon 
13B,  4YR  TOE,  I-IIIA  vs.  Um/TW 
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Figure  26.  Hazard  Function  Comparisons  -  Promodon 
94B,  SYR  TOE,  I-HIA  vs.  IIIB/IV 


Figure  27.  Hazard  Function  Comparisons  -  Promotion 
95B,  SYR  TOE,  I-IIIA  vs.  IIIB/IV 


Proportional  Hazard  Regression  Models 

Specified  Models.  As  with  attrition,  the  first  regression  analyses  conducted 
examined  the  validity  of  four  conceptually  derived  models  to  predict  promotion:  AFQT 
only;  AFQT  and  high  school  graduation  status;  AFQT,  HS,  and  ASVAB  subtests;  and 
AFQT,  HS,  ASVAB  subtests,  and  the  four  interest  measures  contained  in  the  ASVAB 
during  the  period  in  question.  These  results  are  presented  in  Tables  19  through  21. 

Once  again,  Model  2  (AFQT  +  HS)  appeared  to  have  the  most  predictive  power 
across  MOS/TOE  groupings.  This  was  particularly  true  for  3-year  as  opposed  to  4-year 
TOE.  In  fact,  for  Category  IV  personnel,  none  of  the  models  had  much  utility  in 
predicting  promotion  to  E-4  for  those  who  enlisted  for  4  years.  The  explanation  for  this 
(in  terms  of  Model  2,  at  least)  is  that  few  lower-aptitude  nongraduates  were  admitted  to 
service.  For  instance,  in  MOS  IIB,  some  75%  of  the  3-year  Category  FV  enlistees  were 
nongraduates,  as  compared  to  3.9%  of  the  4-year  soldiers. 

Best  Models.  Table  22  shows  the  best  models  for  predicting  promotion  by 
MOS/TOE  group.  As  might  be  expected  given  the  results  just  described,  high  school 
graduation  status  emerged  most  frequently  as  a  significant  predictor  of  promotion  to  E-4 
(Table  23).  Obviously,  this  result  did  not  hold  in  cases  where  there  were  few 
nongraduates  (e.g.,  most  of  the  Category  IV,  4-year  TOE  groups).  Two  other  variables 
that  appeared  to  have  some  promise-  with  this  criterion  were  age  at  entry  and 
Automotive  Information  (AI)  subtest  score.  All  three  of  these  predictors  were  significant 
across  aptitude  groups  for  three  MOS— IIB,  13B,  and  64C  (3-year  TOE).  For  lower- 
aptitude  individuals  (IVs,  IIIB-IV),  they  also  emerged  in  the  case  of  94B.  Note  that  all 
of  the  MOS  were  judged  to  have  high  utility  for  lower  aptitude  soldiers. 

We  investigated  the  applicability  of  the  HS,  AGE,  and  AI  model  by  first  applying 
it  to  the  data  collapsed  across  MOS,  including  all  recruits.  Category  IIIB  &  IVs,  and 
Category  IVs  only.  These  results  are  shown  in  Table  24.  As  can  be  readily  seen,  all  of 
the  variables  were  significant,  with  AI  and  AGE  incrementally  significant  in  each  case. 
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Table  19 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 

(Category  IV) 


ENLISTMENT  TERM  3 


Name 

MOS 

N 

#t»f 

Events 

% 

Promotion 

Model 

•2  L<^  L 

Chi 

Square* 

Infantryman* 

IIB 

13,806 

6384 

46.24 

1 

106,936.93** 

2 

106,658.20 

278.73*** 

3 

106,568.39 

89.81*** 

4 

106,559.00 

9.39* 

Bridge  Crewmember 

12C 

904 

489 

54.09 

1 

5,897.78 

2 

smoe 

9.72** 

3 

5364.03 

24.02* 

4 

5,859.86 

4.18 

Cannon  Crewmember* 

13B 

6,846 

3,455 

50.47 

1 

53360.64*** 

2 

53,207.40 

153.23*** 

3 

53,154.02 

5338*** 

4 

53,147.83 

6.20 

Pershing  Crewmember 

iiiiiiSi 

iHiiisi 

51.47 

1 

3,441.95 

iiiliiiil 

iiiiiil 

3,44104 

0.90 

2032 

3,419.09 

1.63 

ADA  Crewmember 

16R 

1,220 

657 

53.85 

1 

8,133.43* 

2 

8,104.66 

28.77*** 

3 

8,099.46 

5.20 

4 

8,096.26 

3.20 

Teletypewriter 

I'W:- 

289 

:  m 

1 

1,614.87 

Repairer 

2 

1,613.43 

1.44 

3 

1398.41 

15.01 

4 

1,579.3Q 

19.11*** 

Parachute  Rigger 

43E 

608 

252 

41.45 

1 

2,677.43 

2 

2,675.54 

1.89 

3 

2,660.45 

15.09 

4 

2,651.03 

9.42 

Power  Generator 

52D 

308 

183 

59.42 

1 

1,800.12 

Repairer 

2 

1,798.02 

2.10 

3 

1,781.12 

16.91 

4 

1,779.21 

1.91 

Motor  Transport 

64C 

6,018< 

3,823 

6333 

1 

57,15165 

Operator* 

2 

57,038.06 

113.59*  ♦* 

3 

57,005.10 

32i>6*** 

4 

57,000.79 

431  1 

/  Continued  / 
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Table  19 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 
(Category  IV)  (continued) 


ENLISTMENT  TERM  3,  continued: 


Name 

MOS 

N 

#of 

% 

Fromotion 

Model 

”2  Log  L 

Chi 

Square^* 

Adminii^trative 

71L 

1,686 

1,034 

61.33 

1 

12,725.99“ 

Specialist® 

2 

12,692.49 

33.50*“ 

3 

12,673.76 

18.72 

4 

12,665.73 

8.03 

Field  Artillery 

iiiili 

liiiPi 

fiiiiii 

55,56 

liHB 

2^34.10 

Surveyor 

iiiiiiip 

2,522.20 

1149“* 

ii#ii 

241053 

11.67 

4 

2406.87 

3.66 

Food  Service 

94B 

4,454 

2,196 

49.30 

1 

31,724.93 

Specialist® 

2 

31,623.10 

101.83*“ 

3 

31481.06 

42.04*" 

4 

3147832 

2.74 

Military  Police® 

95B 

2,797 

1,817 

64.96 

1 

23450.66 

2 

23415.71 

34.95*“ 

iliiil 

23,495.12 

20.59 

4 

23,483.70 

11.42* 

ENLISTMENT  TERM  4 


Infantryman® 

IIB 

4454 

2,997 

68.83 

1 

2 

3 

4 

41,786.31 

41,782.26 

41,770.17 

41,769.40 

4.05* 

12.09 

0.78 

Cannon  Crewmember® 

24,014.24 

0.00 

IviPvSPppP 

24,015.49 

20.43 

23,987.93 

5.89 

Pershing  Crewmember 

15E 

107 

70 

65.42 

1 

527.88 

2 

527.25 

0.62 

3 

518.08 

9.17 

4 

511.81 

6.27 

Vulcan  Repairer 

im§i 

itSiii;: 

iiillw 

iilPiiiiii 

Biiiiiliii 

4.40 

3 

699  45 

14.84 

iiliiil 

697:83 

1.62 

/  Continued  / 
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Table  19 

Summary  and  SpeciFied  Model  Results  for  Promotion  to  E-4  by  MOS 
(Category  FV)  (continued) 


ENLISTMENT  TERM  4,  continued: 


Name 

MOS 

N 

#of 

Events 

%  ■ 

Promotion 

Mod^ 

-2LogL 

Chi 

Square** 

Teletypewriter 

3U 

199 

126 

63.32 

1 

1,078.62 

Repairer 

2 

1,075.60 

3.02 

3 

1,04732 

28.28” 

4 

1,040.77 

6.55 

Wire  Systems 

36C 

1,898 

1,273 

67.07 

1 

15,903.37’' 

Installer* 

15,858.78 

4439** 

15,840.09 

18.69 

■Bi 

15,831.05 

9.04 

Water  Treatment 

51N 

419 

249 

59.43 

1 

2305.83 

Specialist 

2 

2301.92 

3.91* 

3 

2,490.28 

11.64 

4 

2,487.16 

3.12 

Interior  Electrician 

SIR 

167 

114 

68.26 

963.43 

96033 

2.90 

95036 

9,97 

944.10 

6.46 

Watercraft  Operator 

61B 

197 

107 

54.31 

1 

902.29 

2 

899.88 

2.40 

3 

885.68 

14.20 

4 

88434 

1.34 

Aircraft  Powerplant 

68B 

103 

80 

77.67 

mam 

573.34* 

Repairer 

rnmgmtL 

571.88 

1.45 

555.62 

1626 

■■ 

554.48 

1.14 

®  Entry  grades  combined  and  entered  as  covariate. 

DF  model  1  =  1;  model  2  =  1;  model  3  =  12;  model  4  =  4. 
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Table  20 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 

(Categories  lUB  &  IV) 

ENLISTMENT  TERM  3 


#or 

% 

Chi 

Name 

M05 

N 

Events 

Frmnotiett 

Modd 

.2LogL 

Square*^ 

Infantryman® 

IIB 

18,725 

8,535 

45.58 

1 

14836231 

2 

147,927.05 

335.46*** 

3 

147,814.30 

112.75*** 

4 

147,806.11 

8.18 

Brieve  Crewmember 

12C 

1,339 

52.20 

— 

8,95^37 

8J93538 

1439*'* 

■  8398.61 

3736*** 

1  ' 

8393.44 

5.17 

Caimon  Crewmember® 

13B 

8,691 

4,270 

49.13 

1 

68,00831*** 

2 

67,829.44 

178.86*** 

3 

67,763.88 

6536*** 

4 

67,754.96 

8.92 

Pershmg  Crewmember 

15E 

437 

4932 

t 

5,08532 

2.68 

538233 

iiiiiiaii 

5,062.64 

20.19 

5,06236 

028 

ADA  Crewmember 

16R 

1,443 

756 

52.39 

1 

9,606.86* 

2 

9,578.02 

28.84*** 

3 

9368.17 

9.85 

4 

9,566.68 

1.49 

Teletypewriter 

iillii 

381 

236 

61.94 

2,35630 

4.50* 

Repairer 

2 

2351.99 

3 

iiliiiiiilia 

19.08 

4 

16.93“ 

Parachute  Rigger 

43E 

937 

379 

40.45 

1 

4,356.04 

2 

4,354.38 

1.66 

3 

4,343.96 

10.42 

4 

4,330.54 

13.42" 

Power  Generator 

52D 

602 

339 

56.31 

1 

3,754.81 

Repairer 

2 

3,749.95 

4.86* 

3 

3,735.00 

14.95 

4 

3,731.23 

3.77 

Motor  Transport 

64C 

8,140 

5,086 

62.48 

■■ 

79,015.63 

Operator® 

78,846.75 

168.88*** 

78,804.42 

42.33*** 

bB 

78,803.29 

1.13 

/  Continued  / 
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Table  20 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 
(Categories  IIIB  &  FV)  (continued) 


ENLISTMENT  TERM  3,  continued: 


Name 

MOS 

N 

#of 

Evebts 

% 

Promotion 

Model 

-2LogL 

Chi 

Square** 

Administrative 

71L 

3,233 

2,010 

62.17 

1 

26,722.91** 

Specialist* 

2 

55.59“* 

3 

26,626.60 

40.72“* 

4 

26,624.30 

2.30 

Field  Artillery 

779 

m 

55JS8 

1 

4,977.80 

Surveyor 

7.92* 

25.40* 

4,942.75 

1.72 

Food  Service 

94B 

5,442 

2,670 

49.06 

mm 

39,660.01 

Specialist* 

39,529.73 

130.28“* 

39,473.75 

55.97*“ 

■■ 

39,469.79 

3.96 

Military  Police* 

95B 

6,169 

4,024 

1 

58,42120 

2 

58341.04 

82.17*** 

3 

5839654 

44.50*“ 

4 

58,29134 

5.17 

ENUSTMENT  TERM  4: 


EW/SIGINT 

Interceptor-IMC 

05H 

120 

91 

75.83 

■ 

685.62 

685.19 

678.06 

669.92 

0.43 

7.13 

8.13 

Infantryman* 

IIB 

6,659 

;  4,582 

68.81 

H 

67,421.17 

67,412.77 

8.40** 

■  .  ■  ■■  ■  ■ 

67,393.25 

19.52 

|Dl 

67, 390101 

3.24: 

Caimon  Crewmember® 

13B 

3,669 

2,566 

69.94 

34,689.05 

34,688.78 

34,669.84 

18.94 

IHHI 

34,665.74 

4.11 

Pershing  Crewmember  ^ 

WMjsm 

98 

6282 

796.99 

79632 

0.68 

785.69 

781.64 

4.05 

/  Continued  / 
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Table  20 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 
(Categories  IIIB  &  IV)  (continued) 


ENLISTMENT  TERM  4,  continued: 


Name 

MOS 

N 

#  of 
Events  . 

Model 

>2  LogL 

Chi 

Square** 

Vulcan  Repairer 

27F 

224 

140 

62J0 

1256.97 

1,248.58 

8.38“ 

1,229.55 

19.03 

■■ 

1,227.23 

232 

Teletypewriter 

31J 

2T8 

174 

62.59 

PM 

1,614.40 

Repairer 

1,61285 

135 

1,584J7 

28.28“ 

■IH 

1,579.63 

4.94 

Wire  Systems  Installer* 

36C 

2,417 

1,620 

47.41 

21,03932“ 

.  20,096.70 

62.62“* 

20,948.14 

2835“ 

■■ 

20,941.17 

6.98 

Parachute  Rigger 

43E 

111 

60 

54.05 

429.13 

429.11 

0.02 

403.83 

25.28* 

■■ 

392.10 

11.73* 

Water  Treatment 

582 

343 

5928 

3,706.67 

Specialist 

Hi 

3,698.17 

830“ 

3,681.44 

16.73 

-  3,678.76 

2.68 

Interior  Electrician 

51R 

281 

193 

68.68 

n 

1,829.80 

1,822.07 

7.73“ 

1,802.64 

19.44 

KH 

1,79539 

7.25 

Watercraft  Operator 

61B 

231 

130 

56.28 

1,14125 

r. 

1,137.64 

iyi 

1217.10 

m 

1,115.52 

138 

Aircraft  Powerplant 

68B 

173 

129 

74.57 

1 

1,073.86 

Repairer 

2 

2.32 

3 

11.30 

4 

1.85 

Traffic  Management 

TIN 

141 

84 

59SJ 

1 

669.02 

Coordinator 

2 

662.10 

6.92“ 

3 

64423 

17.86 

4 

.640.33 

3.91 

Military  Police 

95B 

119 

78 

65.55 

566.24 

563.35 

2.89 

555.78 

7.57 

Hi 

554.76 

0.99 

®  Entry  grades  combined  and  entered  as  covariate. 

DF  model  1  =  1;  model  2  =  1;  model  3  =  12;  model  4  =  4. 
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Table  21 


Smnmaiy  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 

(All  Categories) 

ENLISTMENT  TERM  3 


Name 

MOS 

N 

#of 

Events 

% 

Promotion 

Model 

-2LogL 

Chi 

Square*’ 

EW/SIGINT 

OSH 

245 

148 

60.41 

1 

1,346.00 

Interceptor-IMC 

2 

1345.44 

0.56 

3 

12.47 

4 

4.72 

Infantryman* 

IIB 

23^148 

10,797 

46.64 

1 

191,537.46*** 

2 

191,04431 

49265*** 

3 

190,90620 

138.61*** 

4 

190,891.14 

15.06** 

Bridge 

12C 

1,674 

894 

53.40 

1 

11,826.96** 

Crewmember 

2 

11,797.19 

29.76*** 

3 

11,772.03 

25.16* 

4 

11,763.01 

8.99 

Cannon 

13B 

9,771 

4,827 

49:40 

1 

77473.10 

Crewmember* 

iipiiii 

76,950.74 

2?7-.36*** 

iSiilil 

76,86263 

88.11*** 

76,85423 

8.40 

Pershing 

15E 

1,136 

539 

47.45 

1 

6,528.84 

Crewmember 

2 

6324.85 

3.99* 

3 

6,503.71 

21.14* 

4 

6,502.63 

1.07 

ADA  Crewmember 

iiiii 

1,608 

849 

5280 

1 

1037837 

2 

10,94537 

33.60*** 

3 

10,929.93 

15.44 

4 

10,928.07 

1.86 

Teletypewriter 

31J 

476 

299 

62.81 

1 

3,103.40 

Repairer 

2 

3,097.12 

6.28* 

3 

3,078.41 

18.71 

4 

3,068.98 

9.43 

Parachute  Rigger 

43E 

1,276 

534 

41.85 

1 

6,486.36* 

2 

6,477.82 

834** 

3 

6,468.86 

8.95 

4 

6,454.53 

14.33** 

Power  Generator 

52D 

969 

559 

57.69 

1 

6,715.42 

Repairer 

2 

6,691.94 

23.48*** 

3 

6,666.32 

25.62* 

4 

6,663.23 

3.10 

/  Continued  / 
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Table  21 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 
(All  Categories)  (continued) 


ENLISTMENT  TERM  3,  continued: 


Name 

MOS 

N 

#of 

% 

Prom<^0B 

: 

Model 

•2  LogL 

Cbl 

Square** 

Nuclear  Weapons 

55G 

111 

78 

70.27 

1 

598.81 

Maintenance 

2 

598.67 

0.13 

3 

592.78 

■  5.89 

4 

585.91 

6.87 

Motor  Transport 

illiii 

9,986 

6,265 

62.74 

1 

99,794.33* 

Operator* 

2 

99,560.66 

233.67*** 

3 

99,503.98 

56.68*** 

4 

99*501.95 

233 

Administrative 

71L 

5,233 

3,277 

62.62 

1 

46,552.07*** 

Specialist* 

2 

46,441.93 

110.14*** 

3 

46,400.75 

41.18*** 

4 

46386.67 

14.08** 

field  Artillety 

illiii 

piiipi 

58.21} 

1 

9.01834*^** 

■ 

Surveyor 

9,001.93 

8,977.46 

2447* 

4 

8,972,87 

4J9 

Food  Service 

94B 

6,138 

849 

50.02 

1 

46,273.08** 

Specialist* 

2 

46,116.93 

156.14*** 

3 

46,058.88 

58.05*** 

4 

46,053.52 

536 

Military  Police* 

iiiiil 

12,624 

8,619 

68.27 

1 

137,01536*** 

2 

136,897.82 

117J4*** 

3 

136,81238 

8434*** 

4 

136,793.15 

19.73*** 

ENUSTMENT  TERM  4 


EW/SIGINT 

Intcrceptor-IMC 

05H 

531 

414 

77.97 

1 

2 

3 

4 

4.383.66 

4383.66 
4,377.25 
4375.09 

0.00 

6.40 

2.15 

Mantrymaa* 

iiMii 

7378 

69.79 

117,889.40*** 

2 

117,87937 

9.83** 

3 

117,861.49 

18.08 

4 

117,85733 

4.12 

Cannon 

13B 

4,702 

3,277 

69.69 

1 

45,761.21*** 

Crewmember® 

2 

45,760.78 

0.48 

3 

45,737.84 

22.94* 

4 

45,732.51 

5.34 

/  Continued  / 
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Table  21 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 
(All  Categories)  (continued) 

ENLISTMENT  TERM  4,  continued: 


Name 

MOS 

N 

#of 

Events 

% 

Promotkin 

;  Model 

•2LegL 

Chi 

Square** 

Pershing 

15E 

230 

144 

62.61 

n 

1,292.07 

Crewmember 

1,29134 

0.70 

mM 

1279.44 

11.93 

■■ 

1,27438 

5.06 

Vulcan  Repairer 

27F 

333 

207 

62.16 

n 

2,018.79 

HI 

2,008.85 

994** 

IHi 

1,995.98 

12.86 

mm 

1,99237 

3.61 

Teletypewriter 

3U 

374 

244 

6524 

■■ 

•  2,412.14 

Repairer 

mm 

2,408.75 

339 

mM 

2385.20 

2334* 

■H 

2,376.92 

8.29 

Wire  Systems 

36C 

2,786 

1,868 

iliililiil 

24,79035 

Installed 

IBb 

24,706.49 

84.06**”* 

mM 

2436^42 

4336?‘*’* 

24,658.11 

531 

Parachute  Rigger 

43E 

187 

102 

54.54 

H 

Mm 

0.00 

mm 

16.29 

821.84 

5.61 

Water  Treatment 

691 

410 

5933 

n 

4,546.92 

Specialist: 

4,536,84 

4,51832 

ffinPWwonnnm 

' 

iiid 

431536 

Interior  Electrician 

51R 

470 

324 

68.94 

n 

3,394.89 

HH 

mm 

3,379.37 

Mm 

3367.88 

MM 

3,353.18 

14.69** 

Watercraft  Operator 

61B 

269 

153 

56.88 

1 

1,39731 

2 

1391.95 

536* 

3 

1,371.97 

19.97 

4 

1,37120 

0.78 

Motor  Transport 

64C 

no 

72 

65.45 

n 

53125 

Operator 

528.82 

2.43 

Hi 

51226 

16.66 

Hi 

509.91 

225 

Aircraft  Powerplant 

68B 

324 

241 

74.38 

n 

2,313.89* 

■Mi 

Repairer 

MM 

2,307.90 

mm 

2,283.34 

Hi 

2,282.60 

0.74 

/  Continued  / 


Table  21 

Summary  and  Specified  Model  Results  for  Promotion  to  E-4  by  MOS 
(All  Categories)  (continued) 


ENLISTMENT  TERM  4,  continued: 


Name 

N 

#or 

:_\EyentS;;v' 

% 

Promotion 

Mode) 

■IHrT 

Chi 

Square** 

Traffic  Management 

71N 

203 

118 

58.13 

n 

1,020.10 

^m 

Coordinator 

1,008.99  ■ 

992.70 

■1 

987.35 

Computer/Machine 

147 

71.71 

■1 

1,286.09 

Operator 

1,278.24 

735** 

1,260.46 

17.77 

■I 

1,257.03 

3.43 

Still  Photographic 

84B 

128 

83 

64.84 

■I 

64351 

Specialist 

mm 

653.16 

835** 

620.47 

14.68 

mM 

616.94 

353 

Medical  Laboratory 

118 

9681 

8134 

73935 

Spedalisr 

1 

735.61 

3.73 

839 

71837 

834 

Military  Police 

95B 

214 

134 

62.62 

M 

1,126.51 

1,124.45 

2.06 

1,115.71 

8.74 

Hi 

1,113.69 

2.01 

*  Entry  grades  combined  and  entered  as  covariate. 

DF  model  1  =  1;  model  2  =  1;  model  3  =  12;  model  4  =  4. 
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Table  22 

"Best  Models"  of  Promotion  by  MOS  and  Term  of  Enlistment 


MOS 

TOE 

AFQT 

Category 

'■2  Log  L 

Chi  Square 

BEST  MODEL 
VariabltiS 

OSH 

4 

ALL 

531 

No  Significant  Model 

niB  &  IV 

120 

No  Significant  Model 

IIB 

3 

ALL 

23484 

667,47 

HS  AI  NO  AGE  DEPh  CEb 

niB&IV 

18,725 

440,81 

HS  AI  SIb  NO  AGE  DEPb 

IV 

13,806 

362.02 

HS  AI  NO  AGE 

4 

ALL 

10,858  ■ 

5^93 

AFQTHS 

IHB  &IV 

6,659 

839 

HS 

IV 

4354 

10,48 

HS,SP»EI 

12C 

3 

ALL 

1,674 

55.60 

HS  AGE  CA 

niB  &  IV 

1339 

37.69 

HS  AGE 

rv 

904 

23.87 

HS  AGE 

13B 

3 

ALL 

9,771 

294,98 

HS  AINO  AGE 

niB&iv 

8,691 

HS  AI  AD  age 

iiiiifiBiBi 

6,846 

207,72 

HS  AIAGE 

4. 

liiiilPBlll 

4,702 

20.58 

AI 

|il|Ri||||||i 

3,669 

8.97 

AI 

rv 

2,647 

8.86 

AI 

15E 

3 

ALL 

1,136 

11.47 

AGE 

IIIB  &  IV 

886 

8.03 

AGE 

IV 

612 

5.41 

AGE 

4 

ALL 

230 

No  Significant  Model 

IIIB  &  IV 

156 

No  Significant  Model 

IV 

107 

No  Significant  Model 

16R 

3 

ALL 

1,608 

3Z93 

HS 

niB  &  IV 

1,443 

34.01 

HS 

rv 

1,220 

32.83 

HS 

27F 

4 

ALL 

333 

10.59 

HS 

niB  &  IV 

224 

17.77 

HS  GS  AGE 

IV 

138 

12.58 

SP()  AI 

94 


/  Continued  / 


Table  22 

"Best  Models"  of  Promotion  by  MOS  and  Term  of  Enlistment  (Continued) 


MOS 

TOE 

Population 

N 

-2  Log  L 

Chi  Square 

BEST  MODEL 
Variables 

Sill 

3 

ALL 

476 

11.60 

'JPiO' 

HIB&IV 

imil 

m 

IV 

289 

1629 

NOCC 

4 

ALL 

374 

11.18 

AGE 

HIB&IV 

278 

2035 

HS  AI  DEP{4 

liiiiiiliii 

199 

19.16 

AIDEP(4 

36C 

4 

ALL 

2,786 

110.54 

HS  AI  DEPh 

nm&iv 

2,417 

73.68 

HS  DEPh 

rv 

1,898 

54.06 

HS  DEPh 

43E 

3 

ALL 

1^6 

1750 

HSCC 

iipiii 

mB&rv 

937 

630 

cc 

IV 

608 

Ko  Significant  Model 

4 

ALL 

187 

5.65 

AD 

ifiipiijH 

U1 

9.20 

NO 

51N 

4 

ALL 

691 

10.06 

HS 

iiiB  &  rv 

582 

8.01 

HS 

IV 

419 

No  Significant  Model 

SIR  ' 

ililill 

ALL 

470 

25.01  : 

HSCE 

niB&rv 

281 

7.14 

AGE 

IV 

167 

illlilSiilfii 

AGE  CM 

52D 

3 

ALL 

969 

33.97 

HS  DEPh 

IIIB  &  rv 

602 

8.61 

AGE 

IV 

308 

9.28 

AGE,  GS 

61B 

4 

ALL 

269 

10.95 

SP  AGE 

fflB  &rv 

231 

10.98 

SPACE 

rv 

197 

4.43 

AGE 

64C 

3 

ALL 

9,986 

298.90 

AFQT  HS  AI  AGE  DEPh 

IIIB  &  IV 

200.93 

AFQT  HS  AI  AGE 

IV 

6,018 

D1.18 

HS  AI  AGE 

/  Continued  / 
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Table  22 

"Best  Models"  of  Promotion  by  MOS  and  Term  of  Enlistment  (Continued) 


MOS 

TOE 

Population 

N 

*2 

Chi  5qi2^ 

BEST  MODEL 
Variables 

6SB 

4 

ALL 

324 

8.80 

GI 

iKB&rv 

m 

T4o  Significant  Model  || 

rv 

103 

7.64 

SP,  OEPh 

71L 

3 

ALL 

5;233 

186.60 

HS  AI  NO  DEP(.)  CM(.) 

niB  &  IV 

3,233 

90.06 

HS  AINO 

IV 

1,686 

54.71 

AFQT  HS  AI  CA 

7lN 

4 

iliiiii 

ALL 

203 

21.83 

RKNO 

mB&rv 

141 

13.43 

HSSI 

82C 

3 

ALL 

1,244 

44.70 

HS  AI  AGE 

mB  &  rv 

779 

16.12 

HS  AI 

rv 

441 

1130 

HS 

94B 

3 

ALL 

6,1^ 

206.93 

HS  El  AGE  OEPh 

mB&iv 

5,442 

17L13 

HS  AIAGE 

rv 

4,454 

135.07 

HS  AIAGE 

95B 

3 

ALL 

12,624 

261.87 

HS  El  NO  AGE  DEP(.) 

CA  CE(.) 

iiiB  &  rv 

6,169 

112.0 

HS  GS  AGE 

rv 

2,797 

42.84 

HS  CA 

4 

ALL 

214 

No  Significant  Model 

IIIB  &  IV 

119 

No  Significant  Model 
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Table  23 

Frequency  of  Variable  Significance  in  Predicting  Promotion 
by  AFCyr  Grouping 


Predictor 

Category  IV 
(23  models) 

Category  IIIB  &.  IV 
(27  models) 

All 

»  (27  models) 

HS 

11 

15 

17 

AFQT 

1 

1 

2 

GS 

1 

2 

0 

MC 

0 

0 

0 

SP 

3 

1 

.  -  1 

AI 

8 

8 

7 

SI 

0 

2 

0 

El 

1 

0 

2 

Gl 

0 

0 

1 

AD 

0 

1 

1 

NO 

2 

4 

6 

AGE 

9 

11 

10 

DEP 

3 

3 

7 

BMASS 

0 

0 

0 

CA 

2 

0 

2 

CC 

1 

1 

1 

CE 

0 

0 

3 

1 

0 

1 
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Table  24 

Summary  and  Specified  Model  Results  with  Promotion  to  E-4  Criteria 


AFQT  Category 

TOB 

N 

#of 

Events 

% 

Fromodon 

Model 

-2  Log  L 

Cbi 

Sqoare** 

ALL 

B 

23^88 

16,253 

68.90 

1 

278,786.29*** 

HH 

2 

278,724.96 

■ 

3 

278,713.37 

iiiB&rv 

B 

15,884 

10,808 

68.04 

1 

177,955.88*** 

2 

177,931.09 

24.79“* 

■ 

.3. 

177,917.14 

13.95“* 

IV 

H 

10,963 

7,466 

68.10 

1 

117,73834*** 

2 

117,72132 

17.02“* 

■ 

3 

117,710.10 

11.22“ 

ALL 

iiiil 

76,594 

42^112 

54.98 

iiliiii 

835,18834*** 

a 

834,78031 

407.83*“ 

' 

3 

834,629.95 

150,55“* 

uiB  &  rv 

3 

57,614 

30,440 

52.83 

1 

589,205.72*** 

2 

589,017.18 

188.54"* 

3 

588,896.26 

120.92*** 

IV  . 

3 

40,663 

21,471 

52.80 

1 

401,395.95*** 

2 

401,19729 

118.66'** 

3 

401,117.73 

7937"* 

*  Model  1  =  HS;  Model  2  =  HS,  AI;  Model  3  =  HS,  AI,  AGE. 
DF  =  number  of  variables  m  model  -1. 
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To  further  investigate  the  generalizability  of  the  model,  we  then  applied  it  within 
MOS  selected  to  represent  various  levels  of  utility  for  low-aptitude  soldiers  (see  Table 
25).  Model  1,  high  school  graduation  status,  was  most  uniformly  significant  across  jobs. 
Perhaps  the  most  noteworthy  finding  regarding  the  additional  variables  is  that  they 
uniformly  failed  to  achieve  incremental  significance  only  for  those  MOS  that  have  been 
judged  to  be  of  medium  or  low  utility  for  lower  aptitude  personnel  (15E,  27F,  51R). 
Beyond  this,  the  pattern  was  somewhat  mixed;  AI  alone  emerged  for  Category  IV 
soldiers  in  64C  and  71L,  whereas  both  AI  and  age  contributed  significantly  in  IIB,  12C, 
and  94B. 

It  is  clear  once  again  that  completion  of  high  school  was  a  key  indicator  of  the 
likelihood  of  success  in  service.  In  this  case,  automotive  information  subtest  score  and 
age  contributed  to  the  prediction  of  promotion  likelihood,  particularly  in  those  MOS  that 
were  of  high  utility  for  lower  aptitude  personnel.  However,  because  of  the  variability  of 
these  findings,  they  must  be  evaluated  in  conjunction  with  the  other  performance  criteria 
before  making  recommendations  concerning  a  truly  "best  model." 

Fairness.  As  was  done  for  attrition,  the  ’best"  promotion  composite  of  HS,  AI, 
and  age  was  evaluated  for  fairness  by  applying  various  cutting  score  levels  (see  Table  26). 
Emphasizing  the  results  for  soldiers  in  the  three  year  term  of  enlistment  group,  blacks 
were  somewhat  less  likely  to  be  excluded  by  the  application  of  the  composite-ovring  to 
the  greater  proportion  of  high  school  graduates  among  blacks.  However,  excluded  blacks 
were  more  likely  to  be  promoted  than  excluded  whites.  In  fact,  one  might  have  expected 
the  disparity  between  white  and  black  exclusion  rates  (in  favor  of  the  latter)  to  have  been 
higher  considering  their  relative  promotion  rates. 
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Table  25 

Model  FitAncremental  Fit  of  "Best"  Models® 
for  Promotion  by  Selected  MOS 


MOS 

TOE 

AF(rr 

Category 

N 

#or 

Events 

% 

Promotion 

Model 

•2LogL 

Chi 

Square** 

IIB 

3 

ALL 

23,184 

10,797 

4637 

1 

191,11933“* 

2 

191,014.79 

10434“* 

3 

190,99136 

23.23*“ 

IIIB  &  IV 

18,725 

8,535 

45.58 

1 

147,938.51“* 

2 

147,897.03 

41.49“* 

3 

147,873.70 

2333*** 

rv 

13,806 

634 

4624 

1 

106,66127*“ 

2 

106,62935 

31.92*** 

3 

106,61034 

19.01*“ 

12C 

iiiii: 

ALL 

1,674 

894 

53.40 

1 

1L803.18“* 

2 

11,799-06 

4.12*  . 

Ifiilllli 

3 

11,783:25 

15.81*“ 

niB&iv 

836.01“* 

8,934.66 

135 

Hiiiiiil 

' 

3 

8,913.15 

2131*“ 

IV 

489 

1 

5,888.08*“ 

2 

5,88738 

30 

3 

5M-09 

13-49“' 

15E 

4 

ALL 

230 

144 

62.61 

1 

1,535.34 

2 

1,535.32 

.02 

3 

1,532.95 

2.36 

IIIB  &  IV 

156 

98 

62.82 

1 

79733 

2 

796.67 

.66 

3 

795.50 

1.16 

IV 

107 

70 

65.42 

1 

527.42 

2 

527.17 

.25 

3 

526.56 

.61 

/  Continued  / 
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Table  25 

Model  Ht/InCTemenlal  Rt  of  'Best*  Models* 
for  Promotion  by  Selected  MOS  (continued) 


MOS 

TOE 

AFQT 

Categoiy 

N 

Eventsr 

% 

Fromotlon 

Model 

•2  L<^L 

Chi 

Stjuaw?' 

27F 

4 

axx* 

333 

207 

62.16 

1 

2,009.79"* 

2 

2,006.17 

3.62 

3 

2,003.59. 

238 

IIIB  &  IV 

224 

140 

6250 

1 

1,248.82" 

2 

L24621 

Z6l 

3 

1,241.57 

4.64  ' 

lY 

138 

90 

65.22 

1 

718.04 

2 

713.50 

434* 

3 

713.10 

,40. 

\ 

4 

ALL 

470 

324 

68.94 

1 

3,38032"* 

51R 

2 

3380.16 

.15 

3 

3,377.60 

2.57 

niB  &  IV 

281 

193 

68.68 

1 

2 

.35 

3 

6.17* 

rv 

167 

114 

68.26 

1 

961.06 

2 

961.03 

.03 

3 

955.57 

5.46 

64C 

9,986 

6,265 

62.74 

1 

99,587.41*" 

2 

99,54738 

3983*“ 

3 

99,527.79 

1979"* 

IIIB  &  IV 

MKBSi 

5,086 

62.48 

I 

78,860.10*" 

2 

78,83935 

20.85*" 

3 

78,825.04 

1432"* 

IV 

6,018 

3,823 

63.53 

1 

57,04332"* 

2 

57,02832 

1531"* 

3 

57,021.25 

7.or 

/  Continued  / 
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Table  25 

Model  Fit/Incremental  Fit  of  "Best"  Models* 
for  Promotion  by  Selected  MOS  (continued) 


MOS 

TOE 

AFQT 

Categoty 

N 

#of 

Events 

% 

Promotion 

Model 

'2LogL 

Chi 

Sqnate** 

71L 

a 

ALL 

5>233 

3,277 

62.62 

1 

46,483il5^ 

2 

46,446.61 

37.04*“ 

3 

46,443,49.. 

3.11 

nm  &IV 

3;233 

2,010 

62.17 

1 

26,677.45*“ 

2 

26,65624 

21.20“* 

3 

26,654.09 

2.15 

TV 

1,034 

6133 

1 

12,70L08*** 

2 

12^124 

933“ 

3 

12,687,65 

3.59 

94B 

3 

ALL 

6,138 

3,070 

50.02 

1 

46,132.08“* 

2 

46,106.03 

26.04*“ 

3 

46,084.48 

21.55*“ 

niB  &  IV 

5,442 

2,670 

49.06 

1 

3933420*“ 

2 

29,517.11 

17.09“* 

3 

39,488.95 

28.15*** 

IV 

4,454 

2,196 

49.30 

1 

31,624.30*** 

2 

31,611.26 

13.04*** 

3 

31,591.38 

19.88*“ 

3 

ALL 

12,624 

8,619 

6827 

t 

136,924.20“* 

95B 

2 

136,89323 

30.97*“ 

3 

136,85837 

34.86“* 

IIIB  &  IV 

6,169 

4,024 

65.23 

I 

58,341.35*“ 

2  ■■ 

58,335.60 

5.74 

3 

58,317.69 

17.91“* 

IV 

2,797 

1,817 

64,96 

1 

23,516.04*“ 

2 

23,515.97 

.06 

3 

23,510.99 

4.99 

*  Model  1  =  HS;  Model  2  =  HS,  AI;  Model  3  =  HS,  AI,  AGE. 
DF  =  number  of  variables  in  model  -1. 
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Table  26 


Percentages  of  White  and  Black  AFQT  Category  HIB  &  IV  Male  Soldiers 
Excluded  and  Promotion  Rates  for  Those  Excluded  at  Various  Best  Promotion 
Model  Cutting  Score  Levels  by  Term  of  Enlistment 


■  ■ 

Tetm  oC  Enlistment  3 

Term  of  Enlistment  4  ' 

Cutting 

%  Bxciodeit 

%  Attrition 

%  Excluded 

%  Attrition 

Score 

levels 

Wbite 

Black 

White 

Black 

White 

Black 

White 

Black 

95 

94.8 

95.0 

63.8 

112 

92.9 

96.9 

47.6 

57.6 

90 

89.7 

89.9 

63.7 

112 

86.0 

93.9 

46.4 

57.0 

85 

853 

83.8 

633 

71.0 

78.6 

903 

453 

563 

80 

80.8 

77.9 

63.0 

70.9 

71.9 

87.0 

443 

553 

75 

Tin 

71.5 

62.9 

71.0 

65.7 

S2.1 

43.5 

54.1 

%  HSDG 


32,472 

32.0 


21,306 

553 


7,942 

88.7 


SOT  Performance 

Specified  Models.  As  with  the  other  criterion  measures,  hierarchical  sets  were 
used  to  predict  SQT  performance.  SQT  was  regressed  on  these  a  priori  predictor  sets  by 
MOS  among  Category  IV  recruits  alone,  for  Category  IIIB  and  Category  IV  recruits 
combined,  and  for  all  male  soldiers  within  the  22  MOS  available  for  SQT  analyses.®  The 
results  are  displayed  in  Tables  27  through  29. 

There  are  many  notable  points  to  be  derived  from  inspection  of  these  tables. 

Most  broadly,  the  predictor  sets  were  generally  significant  within  MOS  (significance  was 
tempered  mostly  by  number  of  MOS  incumbents)  with  incremental  validity  maximized  by 
model  3  containing  AFQT,  high  school  graduation  status,  ASVAB  cognitive  subtests,  and 
a  few  demographics  or  background  characteristics  (i.e.,  presence  of  dependents,  age, 
bodymass).  Though  the  addition  of  interest  measures  via  model  4  was  often  significant 
and  sometimes  incrementally  valid  over  model  3,  it  generally  showed  little  practical 
significance.  That  is,  whereas  there  were  at  least  moderate  gains  from  model  3  in  the 
percentage  of  variance  accounted  for,  the  addition  of  model  4  boosted  the  on  average 
.01  or  less.  A  tally  of  each  of  the  model’s  standings  is  as  follows: 

Category  IV  Category  IIIB+IV  Category  I-IV 

Number  of  MOS 


with  N  ^  100 

14 

15 

21 

Model  1  significant 

10 

13 

21 

Model  2  significant/ 
incrementally  valid 

11/2 

12/2 

20/3 

Model  3  significant/ 

incrementally  valid 

12/9 

13/10 

19/14 

Model  4  significant/ 

incrementally  valid 

11/5 

13/5 

18/5 

Of  course,  by  combining  AFQT  categories  there  were  more  MOS  with  sufficient 
numbers  of  soldiers  (i.e.,  N  ^  100)  ayailable  for  analyses  and  validity  coefficients  (or  as 
tabulated,  coefficients  of  determination)  rose  accordingly  with  the  increase  in  range. 


’SQT  data  were  unavailable  for  MOS  51N,  61B,  and  84B. 
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Table  27 

Summary  and  Specified  Model  Results  for  SQT  by  MOS 
(Category  IV) 


Name 

MOS 

N 

Y  (SD) 

SQT 

Range 

Mo<M 

;i|||||| 

Model 

2 

Modd 

3 

Model 

Morse  Interceptor 

OSH 

16 

83.5  (21.7) 

43.9  -  124.3 

.26* 

.26* 

.98ns 

1.00ns 

Infantryman 

IIB 

13,340 

99.0  (17.5) 

10.1  -  142.5 

.02*** 

.02*** 

:08***' 

.09***' 

Bridge  Crewmember 

12C 

479 

97.5  (16.2) 

19.9  -  132.8 

.02** 

.02** 

.06** 

.08** 

Cannon  Crewmember 

13B 

7,827 

98.5  (18.3) 

3.8  -  160.6 

.002*** 

.002** 

.04***' 

.04*** 

Pershing  Crewmember 

15E 

209 

88.9  (17.6) 

39.8  -  146.1 

.003ns 

.04*' 

.26***' 

.28*** 

ADA  Crewmember 

16R 

S4S 

94.4  (20.1) 

10.0  - 133.8 

.01ns  • 

.02**' 

.09***' 

.10*** 

Vulcan  Repairer 

27F 

44 

93.5  (16.9) 

44.6  -  128.2 

.01ns 

.03ns 

.28ns 

.38ns 

Teletypewriter 

Repairer 

31J 

1S2 

89.9  (17.9) 

33.1-  124.3 

.04* 

.04ns 

.21**' 

.22** 

Wire  Systems  Installer 

36C 

1,461 

99.8  (19.5) 

24.5  -  140.0 

.0001ns 

.004*' 

.02** 

.02* 

Parachute  Rigger 

43E 

182 

91.7  (18.2) 

42.0  -  146.0 

.03* 

.04* 

.09ns 

,12ns 

Interior  Electrician 

SIR 

S6 

101.6  (15.0) 

71.0  -  136.7 

.01ns 

.01ns 

.24ns 

.30ns 

Power  Generator 
Repairer 

S2D 

ns 

96.3  (17.5) 

44.2  -  142.2 

.01ns 

.02ns 

.10ns 

.12ns 

Nuclear  Weapons 
Specialist 

55G 

3 

94.6  (6.6) 

89.8  -  102.1 

.40ns 

.40ns 

1.00ns 

1.00ns 

Motor  Transport 
Operator 

64C 

4,179 

94.8  (17.0) 

11.0  -  157.0 

.04*** 

.04*** 

.12***' 

Aircraft  Powerplant 
Repair 

68B 

24 

99.9  (21.0) 

46.9  -  124.8 

.14ns 

.23ns 

.75ns 

.89ns 

Admin  Specialist 

71L 

667 

92.0  (17.2) 

18.5  -  145.6 

.02*** 

.02** 

.05*** 

.07***' 

Traffic  Mgmt. 
Coordinator 

71N 

42 

98.0  (18.0) 

51.7  -  129.4 

.03ns 

.06ns 

.50ns 

.63* 

Computer  Operator 

74D 

21 

91.5  (22.8) 

55.0  -  130.1 

.14ns 

.17ns 

.71ns 

.89ns 

Field  Artillery 

Surveyor 

82C 

481 

94.6  (17.4) 

24.1  -  141.6 

.02** 

.03** 

.11***' 

.12*** 

Medical  Laboratory 
Specialist 

92B 

71 

95.5  (21.1) 

15.4  -  136.7 

.02ns 

.02ns 

.18ns 

.32ns 

Food  Service 

Specialist 

94B 

2,643 

96.0  (18.2) 

1.0  -  140.9 

.03*** 

.03*** 

.12***' 

Military  Police 

95B 

1,551 

91.7  (18.0) 

23.2  -  151.9 

.01** 

.01** 

.05***' 

.06***' 

Notes:  *  =  p<.05;  **  =  p<.01;  =  p<.001.  '“InCTemental  Validity 
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Table  28 

Summary  and  Specified  Model  Results  for  SQT  by  MOS 
(Categoiy  DIB  &  IV) 


Pliiiiliiiiii 

iiiiii 

Name 

MOS 

N 

y  (SD) 

SOT 

Ranger 

Model 

1 

Modd 

2 

Modi^ 

3 

Model 

4 

Morse  Interceptor 

OSH 

S6 

90.2  (21.3) 

43.9  -  126.5 

.003ns 

.03ns 

.39* 

.44ns 

Infantryman 

IIB 

18,661 

100.6  (17.3) 

10.1  -  145.0 

.04*  •* 

.04*** 

.11***' 

.11***' 

Bridge  Crewmember 

12C 

67S 

98.7  (15.7) 

19.9  -  132.8 

.03*** 

.03*** 

.05** 

.05**' 

Cannon  Crewmember 

13B 

10,185 

99.3  (18.1) 

3.8  -  165.0 

.007*** 

.007*** 

.05***' 

.05*** 

Pershing  Crewmember 

15E 

302 

90.7  (17.9) 

39.8  -  151.2 

.02* 

.04**' 

.25***' 

.25*** 

ADA  Crewmember 

16R 

628 

95.8  (19.2) 

10.0  -  136.6 

.03***  ■ 

.05***' 

.12***' 

.13*** 

Vulcan  Repairer 

27F 

69 

94.1  (17.1) 

44.6  -  128.2 

.0002ns 

.004ns 

.30ns 

.37ns 

Teletypewriter 

Repairer 

31J 

203 

90.9  (19.1) 

1.8  -  125.1 

.03* 

.03ns 

.19*** 

.21*** 

Wire  Systems  Installer 

36C 

1,864 

100.6  (19.2) 

24.5  -  144.0 

.002ns 

.005** 

.02***' 

.03*** 

Parachute  Rigger 

43E 

279 

92.9  (18.0) 

42.0  -  146.0 

.03** 

.03* 

.08ns 

.09ns 

Interior  Electrician 

SIR 

89 

102.3  (17.0) 

40.2  -  154.0 

.05* 

.05ns 

.19ns 

.20ns 

Power  Generator 
Repairer 

S2D 

234 

97.2  (18.7) 

40.0  -  142.2 

.002ns 

.01ns 

.07  ns 

.09ns 

Nuclear  Weapons 
Specialist 

SSG 

10 

96.1  (15.5) 

62.3  -  124.6 

.02ns 

.21ns 

1.00ns 

1.00ns 

Motor  Transport 
Operator 

64C 

5,522 

96.8  (16.9) 

11.0  -  167.2 

.07*** 

.07*** 

.16***' 

.16***' 

Aircraft  Powerplant 
Repair 

68B 

52 

99.7  (18.5) 

46.9  -  124.8 

.03ns 

.03ns 

.35ns 

.37ns 

Admin  Specialist 

71L 

1,257 

93.5  (18.0) 

18.5  -  166.7 

.03*** 

.03*** 

.07***' 

.08*** 

Traffic  Mgmt. 
Coordinator 

71N 

69 

100.8  (15.6) 

51.7  -  129.4 

.04ns 

.07  ns 

.30ns 

.42* 

Computer  Operator 

74D 

41 

94.4  (22.5) 

52.2  -  130.1 

.07ns 

.07  ns 

.45  ns 

.58ns 

Field  Artillery 

Surveyor 

82C 

824 

96.9  (17.2) 

15.3  -  145.1 

.04*** 

.04*** 

.13***' 

.14*** 

Medical  Laboratory 
Specialist 

92B 

137 

96.8  (20.7) 

15.4  -  136.7 

.04* 

.04ns 

.19* 

.23* 

Food  Service 

Specialist 

94B 

3,224 

97.4  (18.0) 

1.0  -  140.9 

.05*** 

.05*** 

Military  Police 

95B 

3,537 

94.8  (17.8) 

12.0  -  151.9 

.03*** 

.03*** 

.10***' 

Notes:  *  =  p<.05;  **  =  p<.01;  ***  =  p<.001.  '“Incremental  Validity 
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Table  29 

Summaiy  and  Specified  Model  Results  for  SQT 
(Category  I-IV) 


R* 

Name 

MOS 

'N 

Y  (SD) 

SQT  ' 
jRangiet 

Model 

1 

Model  Mo(M 

MbM' 

Morse  Interceptor 

OSH 

284 

101.6  (19.7) 

26.1  - 134.5 

.15*** 

.15*** 

28***' 

30*** 

Infantryman 

IIB 

2S,81S 

104.2  (18.0) 

10.1  -  147.9 

.15*** 

.15***' 

.20***' 

.20***' 

Bridge  Crewmember 

12C 

865 

100.9  (16.5) 

19.9  - 144.9 

.lO*** 

.10*** 

.13*** 

.13*** 

Cannon  Crewmember 

13B 

12,188 

100.7  (18.3) 

3.8  -  165.0 

.03*** 

.04***' 

.08***' 

.08*** 

Pershing  Crewmember 

15E 

444 

95.9  (19.8) 

39.8-151.2 

.16*** 

.  .17*** 

32***' 

33*** 

ADA  Crewmember 

16R 

725 

98.1  (20.2) 

10.0  -  138.0 

.11***  • 

.12*** 

19***' 

.20*** 

Vulcan  Repairer 

27F 

121 

98.1  (19.2) 

36.8  -  135.9 

.06** 

.06* 

.22* 

.26* 

Teletypewriter 

Repairer 

31J 

269 

95.4  (19.3) 

1.8  -  126.9 

.20*** 

.20*** 

29***' 

/ 

.29*** 

Wire  Systems  Installer 

36C 

2,159 

101.1  (19.4) 

24.5  -  150.0 

.01*** 

.01*** 

.03***' 

.03*** 

Parachute  Rigger 

43E 

426 

98.2  (20.0) 

42.0  -  169.1 

.17*** 

.17*** 

.21*** 

.22*** 

Interior  Electrician 

SIR 

155 

105.0  (19.0) 

40.2  -  1673 

.05** 

.05* 

.15* 

.18ns 

Power  Generator 
Repairer 

S2D 

412 

100.4  (19.5) 

40.0  -  153.9 

.05*** 

.05*** 

.19***' 

.19***  - 

Nuclear  Weapons 
Specialist 

SSG 

26 

98.2  (17.4) 

57.6  -  124.6 

.11ns 

.11ns 

.41ns 

.72ns 

Motor  Transpon 
Operator 

64C 

6,781 

99.6  (18.2) 

11.0  -  167.2 

.16*** 

.16*** 

.24***' 

.24***' 

Aircraft  Powerplant 
Repair 

68B 

101 

101.9  (18.8) 

35.8  -  124.8 

.05* 

.05ns 

.21ns 

.23ns 

Admin  Specialist 

71L 

2,149 

99.0  (20.3) 

18.5  -  169.0 

.18*** 

.18*** 

.23***' 

.24***' 

Traffic  Mgmt. 
Coordinator' 

71N 

108 

103.6  (16.6) 

51.7  -  143.1 

.09** 

.11** 

.21ns 

.25ns 

Computer  Operator 

74D 

104 

103.8  (20.6) 

38.6  -  133.7 

.18*** 

.20*** 

.32*** 

.33** 

Field  Artillery 

Surveyor 

82C 

1,477 

102.7  (19.1) 

153  -  178.4 

.20*** 

.20***' 

.26***' 

.26*** 

Medical  Laboratory 
Specialist 

92B 

426 

102J  (18.7) 

15.4  -  139.8 

.09*** 

.09*** 

.17***' 

.18*** 

Food  Service 

Specialist 

94B 

3,687- 

99.4  (18.5) 

1.0  -  140.9 

.12*** 

.12*** 

.20***' 

.21***' 

Military  Police 

95B 

7,907 

100.9  (18.3) 

12.0  -  151.9 

.13*** 

.13*** 

Notes:  ♦  =  p<. 05;  **  =  p<.01;  ***  =  p<.001.  ‘  “  Incremental  Validity 
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More  importantly,  the  14  variable  model  3  was  significant  in  almost  all  of  the  "available 
MOS  and  generally  was  at  least  equal  to  models  2  and  4  in  terms  of  the  number  of  MOS 
for  which  it  was  significant  Furthermore,  it  surpassed  models  2  and  4  in  terms  of 
incremental  validity.  For  example,  among  Category  IV  recruits  alone,  model  3  was 
significant  in  12  of  14  MOS  and  in  9  of  the  12  it  signicantly  added  to  the  prediction  of 
SQT  above  AFQT  and  high  school  graduation  status.  There  would  appear  to  be 
additional  variance  accounted  for  by  variables  beyond  AFQT  and  high  school  status  for 
all  soldiers  but  particularly  for  below  average  personnel.  Among  Category  IV  personnel 
only,  by  using  the  AFQT  alone  as  a  predictor  (model  1),  was  at  best  .04  within  MOS 
31J  and  64C  whereas  model  3  R^s  at  .21  and  .12,  respectively,  showed  incremental 
validity  over  AFQT  plus  high  school  graduation  status.  For  15E  which  was  associated 
with  the  highest  proportion  of  SQT  variance  accounted  for  by  Model  3  at  .26,  model  1 
validity  was  less  than  .10  (R^  =  .003). 

A  rearrangement  of  the  data  in  Tables  27  through  29  by  ranking  MOS  in  terms  of 
model  3  validity  and  mean  SQT  scores  is  provided  in  Table  30  for  the  three  AFQT 
groupings.  Information  regarding  MOS  utihty  for  low  aptitude  persormel  and  training 
costs  eruiches  the  analyses. 

Note  the  preponderance  of  high  utility  (H)  MOS  ^  among  the  top  10  in  terms  of 
SQT  performance  among  both  Category  IV  zmd  Category  IIIB  plus  IV  groupings.  As 
might  be  expected,  higher  average  SQT  results  for  below  average  aptitude  soldiers  were 
found  in  jobs  which  a  priori  were  judged  to  be  relatively  good  assignments  for  low 
aptitude  persormel.  Model  3  validity  rankings  provide  complementary  findings.  There 
was,  more  or  less,  an  inverse  relationship  between  performance  rankings  and  model  3 
validity  rankings:  Jobs  wherein  lower  aptitude  personnel  did  relatively  well  tended  not  to 
be  among  those  with  the  highest  model  3  validities.  Furthermore,  MOS  that  were  low  in 
utility  (L)  for  the  below  average,  generally  had  the  highest  model  3  validities.  Simply 
put,  MOS  in  which  lower  aptitude  incumbents  were  more  in  need  of  compensatory 

factors  were  those  in  which  these  factors  proved  more  useful. 

1 

- — -  i 

®  See  Editor’s  Notes,  Note  4.  ' 


108 


Table  30 

Rankings  and  Characteristics  of  MOS  Based  on  SQT  Variance 
Accounted  for  and  Mean  SQT  Score  for  AFQT  Groupings 


CATEGORY  IV 


Significant*  Top  10  Validity  (Model  3) 


Top  10  Performance 


Training 

Time 


Mean  SQT 
Score 


CATEGORY  mB+IV 


Training 

Time 


Mean 

SQT 


CATEGORY  I-IV 


Training 

Time 


Mean 

SQT 


N  <.  300-p  <.  .05 
N  >  300-p^.01 


More  concretely,  those  in  Category  IIIB  and  IV  performed  relatively  well  as  wire  systems 
installers  (36C)  and  infantrymen  (IIB).  Within  such  MOS,  the  addition  of  ASVAB 
subtest  or  demographic  information  did  not  improve  prediction  greatly.  Though  those 
having  below  average  general  cognitive  aptitude  levels  tended  to  perform  poorly  as 
Pershing  crewmembers  (13B)  and  teletypewriter  repairers  (31J),  the  addition  of  ASVAB 
subtest  and  demographics  was  particularly  predictive  in  these  MOS. 

Regarding  training  costs,  lower  aptitude  soldiers’  performance  tended  to  be  higher 
in  MOS  with  low  or  moderately  low  training  costs.  On  the  other  hand,  model  3  validities 
generally  were  most  concentrated  in  moderately  high  and  high  cost  MOS.  Findings  for 
all  categories  combined  appear  to  be  less  complementary.  However,  performance 
rankings  with  "good"  showings  for  low  utility  MOS  no  doubt  were  influenced  by  the 
underrepresentation  of  below-average  personnel  among  these  MOS.  All  in  all,  the 
relationships  uncovered  through  this  hierarchical  analysis  may  prove  useful  in  selecting 
and  assigning  the  best  of  the  below-average. 

Best  Models.  Though  the  above  hierarchical  analyses  were  enlightening  and 
provided  useful  guidance,  a  14  variable  model  is  rather  cumbersome.  Thus,  generation 
of  empirically  derived  best  models  proceeded  in  an  iterative  fashion  for  SQT  as  for 
attrition  and  promotion.  However,  given  that  this  criterion  lends  itself  to  more 
traditional  ordinary  least  squares  regression  analyses,  a  brief  description  and  an  example 
relative  to  SQT  is  warranted.  Table  31  shows  for  Category  UIB  plus  IV  recruits  in  MOS 
IIB  the  values  for  the  three  "best"  models  of  increasing  numbers  of  predictors  up  to 
the  inclusion  of  all  18  predictors.  The  strategy  for  choosing  "the"  best  model  for  the 
AFQT  category/MOS  group  was  to  maximize  R^  parsimoniously.  A  first  dividing  line  or 
stopping  point  delineating  candidate  best  models  was  the  point  at  which,  when  rounded 
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Table  31 


Empirically  Best  Models  for  Predicting  SQT  Performance 
Among  Army  Male  AFQT  Category  IHB  &  IV  Recruits 


MOS  IIB  (N=  18,661) 


#  Variabtes 

Best  Predictors 

le 

in  Model 

1 

El 

.051 

SI 

.043 

GI 

.039 

2 

MCEI 

.066 

EIGI 

.065 

AFQT  El 

.065 

3 

MC  El  NO 

.078 

MC  El  GI 

.077 

SI  El  NO 

.076 

4 

MC  El  GI  NO 

.086 

MC  SI  El  NO 

.085 

GS  MC  El  NO 

.084 

5 

MC  SI  El  GI  NO 

.091 

AFQT  SP  SI  El  NO 

.090 

GS  MC  El  GI  NO 

.089 

6 

AFQT  MC  SP  SI  El  NO 

.095 

AFQT  SP  SI  El  GI  NO 

.094 

MC  SP  SI  El  GI  NO 

.094 

7 

AFQT  MC  SP  SI  El  GI  NO 

.099 

AFQT  GS  MC  SP  SI  El  NO 

.097 

MC  SP  SI  El  GI  NO 

.097 

8 

AFQT  GS  MC  SP  SI  El  GI  NO 

.100 

AFQT  MC  SP  SI  El  GI  NO  AGE 

.100 

AFQT  HS  MC  SP  SI  El  GI  NO 

.100 

9 

AFQT  HS  MC  SP  SI  El  GI  NO  AGE 

.102 

AFQT  GS  MC  SP  SI  El  GI  NO  AGE 

-  .102 

AFQT  HS  GS  MC  SP  SI  El  GI  NO 

.102 

10 

AFQT  HS  GS  MC  SP  SI  El  GI  NO  AGE 

.103 

AFQT  HS  MC  SP  AI  SI  El  GI  NO  AGE 

.103 

AFQT  HS  MC  SP  SI  El  GI  NO  AGE  CE 

.103 

/  Continued  / 


Table  31 


Empirically  Best  Models  for  Predicting  SQT  Performance 
Among  Army  Male  AFQT  Category  IIIB  &  IV  Recruits  (Continued) 


MOS  IIB 


#  Variables  in 

Best  Predictors 

Model 

' 

11 

AFQT  HS  GS  MC  SP  SI  El  GI  NO  AGE  CE 

.104 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE 

.104 

AFQT  HS  MC  SP  AI  SI  El  GI  NO  AGE  CE 

.104 

12 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  CE 

.105 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  CM 

.105 

AFQT  HS  GS  MC  SP  SI  El  GI  NO  AGE  CC  CE 

.105 

13 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  CC  CM 

.106 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  CC  CE 

.106 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  CE 

.106 

14 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  CC  CM 

.106 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  CC  CE  CM 

.106 

AFQT  FIS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  CC  CE 

.106 

15 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  CC  CE  CM 

.107 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  CA  CC  CM 

.106 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  CC  CM 

.106 

16 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  CC  CE  CM 

.107 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  BMASS  CC  CE  CM 

.107 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  CA  CC  CE  CM 

.107 

17 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  BMASS  CC  CE  CM 

■a 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  CA  CC  CE  CM 

■9 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  NODEP  BMASS  CA  CC  CE  CM 

18 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  AD  NO  AGE  NODEP  BMASS  CA  CC  CE  CM 

.107 

to  the  nearest  hundredths,  was  not  incremented  by  at  least  ,01  (see  step  12  in  Table 
31  after  which  point  remains  .11).  Next,  model  significance  aiid  incremental  validity 
of  increasingly  larger  nested  models  up  through  a  12-variable  model  were  tested.  That 
is,  the  foUowing  models  from  Table  31  were  tested; 

El 

MC  El 

MC  El  NO 

MC  El  GI  NO 

MC  SI  El  GI  NO 

MC  SP  SI  El  GI  NO 

AFQT  MC  SP  SI  El  GI  NO 

AFQT  GS  MC  SP  SI  El  GI  NO 

AFQT  GS  MC  SP  SI  El  GI  NO  AGE 

AFQT  HS  GS  MC  SP  SI  El  GI  NO  AGE 

AFQT  HS  GS  MC  SP  SI  El  GI  NO  AGE  CE 

AFQT  HS  GS  MC  SP  AI  SI  El  GI  NO  AGE  CE 

Given  the  power  of  an  almost  19,000  member  sample,  it  was  not  surprising  that  all  of  the 
above  models  were  significant  and  incrementally  valid.  To  reduce  the  set  of  best 
predictors  further  (thereby  avoiding  an  unwieldy  and  impractical  prediction  equation) 
informed  judgement  was  invoked  to  stop  the  addition  of  variables  when  the  F  statistic 
decreased  (and  the  standard,  error  increased)  precipitously-roughly  analogous  to  a  scree 
test  employed  in  factor  analysis.  Ultimately,  a  7-variable  model-AFQT  MC  SP  SI  El  GI 
NO"With  an  R^  value  of  .099  was  chosen  as  the  best  for  Category  IIIB  +  IV  soldiers  in 
IIB.  This  model  along  with  all  of  the  similarly  identified  best  models  for  Category  IV 
alone.  Categories  IIIB  +  IV,  and  Categories  I  through  IV  in  each  MOS  are  shown  in 
Table  32. 

Some  highlights  from  this  table  include  the  statistically  obvious  finding  that  models 
were  stronger  across  all  AFQT  categories  (with  R^  reaching  .256  for  MOS  82C)  than 
within  category  subsets.  Yet,  the  results  for  Categories  IIIB  plus  IV  and  even  for 
Category  IV  alone  were  not  discouraging.  For  example,  in  MOS  15E,  the  three-variable 
best  model  accounted  for  20%  of  the  variance  in  SQT  performance  of  those  scoring 
within  AFQT  Categories  IIIB  and  IV;  and  the  two-variable  model  for  Category  IVs 
accounted  for  almost  as  much  variance  (R^  =  .197).  These  condensed  best  models 
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Table  32 


"Best  Models"  of  SQT  Performance  by  MOS 


MOS 

AFQT 

Category 

IIB 

All 

III  &  IV 

IV 

12C 

ALL 

IBB  &  IV 

rv 

13B 

ALL 

IIIB&IV 

rv 

15E 

ALL 

iBBA  rv 

IV 

16R 

ALL 

iiiB  &  rv 
rv 

31J 

ALL 

BIB  &1V 

rv 

36C 

ALL 

IIIB  &  rv 
rv 

43E 

ALL 

IBB  &  rv 

IV 

52D 

ALL 

IBB  &  IV 

IV 

64C 

ALL 

IIIB  &rv 
rv 

71L 

ALL 

BIB  &  IV 

rv 

82C 

ALL 

IBB  &  IV 

IV 

BSsnrMODBt 

Vambles 


AFQT  MC  SP  SI  El  GI  NO 
AFQT  MC  SP  SI  El  GI  NO 
AFQT  MC  SP  SI  El  GI  NO 


AFQT 
AFQT  SI 
SI 


AFQT  HS(+)  MC  SP  SI  El  NO 
AFQT  HS(+)  MC  SP  SI  El  NO 
AFQT  HS(+)  MC  SP  SI  El  NO 


AFQT  MC  SI  El 
MCAISI 
SI  El 


AFQT  MC  SI  AD 
AFQT  MC  AD 
MC  AD 


AFQTEIBMASSB 

GSBIBMASSI-) 

El  AGE(-)  NODEP(-)  BMASS(-) 


SP  SI  El 
HS(-)  SI  El 
El 


AFQT 
El  NO 
AFQtSP 


AI  El 
El 


No  significant  model 


.235 

AFQT  MC  AI  SI  El  NO  CC(+) 

AFQT  MC  SI  El  NO  CC(+)  CE(-) 

AFQT  AI  SI  El  NO  CQt-)  CE(-) 

.227 

AFQT  SP  El  AD  NO  CA(+) 

.055 

AFQT  NO 

.059 

AFQT  SP  NO  CM(-) 

.256 

■  AFQT  HS(+)  MC  SP  SI  NO 

.119 

AFQT  HS(+)  MC  SP  AI  NO 

.072 

AFQTMCSP 

/  Continued  / 


Table  32 

"Best  Models"  of  SQT  Performance  by  MOS  (continued) 


MOS 

AFQT 

Categofy 

N 

R* 

BEST  MODEL 

Vaiiabies 

92B 

ALL 

426 

.142 

AFQT  MC  AGE(+) 

IIIB  &  IV 

137 

.127 

AFQT  MC  AGE(+) 

94B 

ALL 

.195 

AFQTSPSIEINOCEH 

IIIB  &  IV 

3,224 

.124 

AFQT  SP  SI  El  NO  CE(-) 

IV 

3,643 

.117 

AFQT  SP  SI  El  NO  CC(+)  CE(-) 

95B 

ALL 

.184 

AFQT  GS  MC  SP  SI  GI  NO 

IIIB  &  rv 

.086 

AFQT  GS  MC  SP  SI  GI  NO  CC(+) 

IV 

.046 

GS  MC  NO  AGE(-)  CA(+) 

tended  to  account  for  more  variance  in  MOS  that  were  best  predicted  from  the  specified 
14-variable  model  3  (see  Table  30)  and  to  almost  the  same  degree  as  the  overfitted 
model.  The  highest  best  model  validities  were  found  within  MOS  15E,  64C,  92B,  94B, 
IIB,  and  82C-a  mix  of  low  and  high  utility  MOS. 

Although  identical  best  models  occurred  across  AFQT  groupings  within  MOS  in  a 
few  instances,  best  models  did  not  coincide  across  MOS.  With  the  goal  of  a 
parsimonious  selection  solution  in  mind,  the  iterative  process  of  searching  for  an  efficient 
set  of  predictors  continued.  The  pattern  across  MOS  was  not  random  and  Table  33 
brings  order  to  the  array  of  best  models  by  providing  a  tally  of  each  predictor’s  firequency 
of  inclusion  in  a  best  model.  From  this  frequency  analysis,  six  variables  appeared  to  be 
the  most  promising  for  selecting  below-average  aptitude  recruits:  AFQT,  Mechanical 
Comprehension  (MC),  Space  Perception  (SP),  Shop  Information  (SI),  Electronics 
Information  (El),  and  Numerical  Operations  (NO).  These  same  predictors  were  also  the 
most  popular  best  model  components  across  categories. 

It  is  notable  that  even  within  the  narrower  AFQT  bands,  the  verbal  and  math 
AFQT  composite  entered  as  a  significant  predictor  of  SQT.  The  interest  measures  that 
were  included  in  ASVAB  6/7  as  well  as  the  demographics  proved  weak  in  predictive 
power.  Review  of  Appendix  Table  A-1  showing  the  bivariate  correlations  between  each 
predictor  and  SQT  (across  MOS)  shows  the  variables  pulled  out  of  Table  33  to  be 
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Table  33 


Frequency  of  Variable  Significance  in  Predicting 
SQT  Performance  by  AFQT  Grouping 


Predictor 

Category  IV 

Categoiy  niB  &  IV 

AB 

(14  models) 

(15  models) 

(15  models) 

AFQT 

7 

10 

12 

HS 

1 

3(1-)* 

2 

GS 

1 

2 

1 

MC 

6 

8 

8 

SP 

6 

5 

7 

AI 

1 

2 

2 

SI 

6 

8 

8 

El 

7 

8 

9 

Qt 

1 

2 

2 

AI> 

1 

1 

1 

NO 

6 

8 

7 

AGE 

2- 

1 

1 

DEP 

1- 

0 

0 

BMASS 

1- 

1- 

1- 

CA 

1  + 

0 

1  + 

CC 

2+ 

2+ 

1+ 

CE 

2- 

2- 

1- 

CM 

1- 

0 

0 

“  "a"  indicates  that  the  P  weight  was  negative,  else  there  was  a  positive  coefficient.  In  the  case  of  high  school  graduation  status  (HS). 
one  of  the  three  models  containing  this  variable  contained  a  negative  weight. 


among  those  with  the  strongest  simple  relationship  to  the  criterion  of  interest. 

Automotive  Information  and  General  Science,  which  were  among  the  highest  five  in 

terms  of  correlations  with  SQT  for  Category  IIIB  &  IV  and  Category  FV  alone, 

respectively,  tended  not  to  appear  among  the  best  model  solutions.  A  cursory  review  of 

« 

Appendix  Tables  A-2  through  A-4  suggests  that  redundancy  between  AI  and  SI  (r  =  .62 
for  Category  I-IV)  and  between  GS  and  AFQT  (r  =  .70  for  AFQT  I-IV)  may  have 
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knocked  the  former  member  of  each  pair  out  of  the  running  in  favor  of  the  more 
strongly  criterion  correlated  latter  variables.  Note  also  that  although  SP  was  identified  as 
a  candidate  predictor  from  Table  33,  this  variable’s  correlation  with  SQT  was  relatively 
small.  Furthermore,  although  the  correlation  between  AFQT  and  SP  was  around  .18 
across  all  aptitude  categories,  within  the  subsets  of  below  average  aptitude  personnel 
there  was  a  moderate  negative  correlation  between  these  variables  (e.g.,  r  =  -.52  for 
Category  IV  soldiers).  This  curious  relationship  between  AFQT  and  SP  may  be 
explained  by  the  fact  that  at  the  time  of  the  misnorming,  SP  was  a  component  of  the 
AFQT  and  thus  contributed  to  AFQT  category  definition  then  and  for  these  analyses. 

The  AFQT  predictor  in  the  present  analyses,  however,  is  a  simulated  AFQT  composite 
comprising  Word  Knowledge  and  Arithmetic  Reasoning  subtests  only.  Thus,  it  is  possible 
that  individuals  were  "boosted"  into  Category  IV  and  even  higher  categories  by  their 
showing  on  SP.  Despite  its  relatively  low  simple  correlation  with  SQT  among  below 
average  aptitude  personnel  and  its  sizeable  negative  relationship  with  AFQT,  SP  along 
with  the  other  five  "best"  model  predictors  (AFQT,  MC,  SI,  El,  and  NO)  were  put  to 
further  tests. 

SQT  was  regressed  on  these  eight  variables  as  well  as  on  various  subsets  of  them 
for  the  same  three  AFQT  groupings  within  and  across  MOS.  Tables  34  through  36  show 
the  values  for  each  of  eight  different  models  for  Category  IV,  Categories  IIIB  &  IV, 
and  Categories  I  through  IV,  respectively.  Combined,  these  variables  generally  offered 
better  prediction  of  SQT  than  smaller  subsets  of  these  six  variables.  However,  models  4, 
6,  and  7,  in  addition  to  the  full  model  8,  deserve  further  mention  and  scrutiny.  Model  4 
offers  a  look  at  a  non-AFQT  compensatory  screen  for  below-average  aptitude  recruits. 
Model  6  substitutes  AFQT  for  SI,  which  by  itself  no  longer  exists  as  an  ASVAB  subtest; 
rather  it  has  been  combined  with  the  Automotive  Information  (AI)  subtest  since  1980  to 
produce  an  Auto  and  Shop  Information  (AS)  test.  On  the  basis  of  predictive  power 
alone,  model  8  edged  out  model  7  as  the  best;  however,  model  7  without  the  potentially 
troublesome  SP  subtest  of  yesteryear  approached  and  within  some  MOS  tied  the  R^ 
values  of  model  8.  These  models  were  most  effective  in  MOS  such  as  15E,  64C,  94B, 

16R,  and  IIB,  which  tended  to  be  filled  with  sizable  proportions  of  below  average 
•recruits  and  have  high  utility  for  such  personnel. 


117 


Table  34 


Comparison  of  Models  Containing  "Best" 
Subset  of  Predictors  by  MOS 

(Category  IV) 


Model  Composition  and  Number 

MCNO 

■ 

Mcm 

NO 

MCET 
NO  SI 

MCEI 
NO  SP 
AFQT 

MCET 

NO 

AFQT 

MCEI 
NO  SI 
AFQT 

MCEI  NO 
SISP 

AFQT 

MO$ 

1 

2 

3 

4 

5 

6 

7 

8 

IIB 

.038*** 

.045*** 

.057*** 

.065*** 

.061** 

.060** 

.068** 

.070 

J2C 

.024** 

.015* 

.024** 

.040*** 

.034** 

.032* 

.047*** 

.048*** 

13B 

.014*** 

.015»* 

.020*** 

.023*** 

.027*** 

.024*** 

.026*** 

.029*** 

15E 

.078*  *• 

.111*** 

.138*** 

.216*** 

.140** 

.139*** 

.216*** 

.216***  . 

16R 

.055»» 

.034*** 

.061*** 

.064*** 

.067*** 

.065*** 

.068*** 

.069*** 

.063** 

.066** 

.086** 

.086** 

.090* 

.090** 

.090* 

.090* 

36d 

.002ns 

.009** 

.009** 

.012*** 

.011** 

.009** 

.013** 

.037** 

43E 

.039ns 

.037* 

.039ns 

.041ns 

.054ns 

.052* 

.054ns 

.056ns 

52D 

.019ns 

.034ns 

.036ns 

.041ns 

.048ns 

.037ns 

.041ns 

.056ns 

64C 

.049*  •• 

.085*** 

.095*** 

.108*** 

.102*** 

.lOO*** 

.111*** 

.113*** 

71L 

.029*  •• 

.032*  •• 

.033— 

.033*** 

.041*** 

.040*  •* 

.040** 

.041*** 

82C 

.039*  •• 

.030*  •• 

.050*  •• 

.050*** 

.068*  •• 

.067*** 

.067*** 

.068*** 

94B 

.038*  •* 

.074*  •• 

.081*” 

.102*** 

.087*** 

.086*  •• 

.106*** 

.106*** 

95B 

.027*** 

.024— 

.034*** 

.034*** 

.036*  •• 

.035*** 

.036*** 

.036*** 

ALL* 

.024*  •• 

.032*** 

.039*** 

.045*** 

.044*** 

.042*** 

.047*** 

.050*** 

*  =  p<.05:  *♦  =  p<.0i;  *♦*  =  p<.001;  ns  =  non  significant 
®  All  22  MOS  for  which  there  were  SQT  scores  were  used. 


Table  35 


Comparison  of  Models  Containing  "Best" 
Subset  of  Predictors  by  MOS 

(Category  lUB+IV) 


Model  Composition  and  Number 

MCNO 

El  NO 

MCm: 

NO 

MCEI 
NO  SI: 

MCM 

NOSF 

AFQT 

MCEI 

NO 

AFQT 

MCM 
NO  SI 
AFQT 

MCM  NO 
SISP 

AFQT 

MOS 

1 

2 

3 

4 

5 

6 

7 

8 

IIB 

.055*»» 

.064*” 

.078”* 

.085*” 

.083*** 

.083*** 

.089*** 

.090*** 

12C 

.020‘** 

.011* 

.021** 

.033*** 

.036*** 

.033*** 

.041*** 

.043*** 

V3B 

.024*« 

.023*** 

.031*** 

.035*” 

.037*” 

.035”* 

.037*** 

.040*** 

tSB 

.085*» 

.104*** 

.138”* 

.207*** 

.139*** 

.139*” 

.207*** 

.207*** 

16R-  . 

.071*” 

.050*** 

•.081*” 

.089*** 

.094** 

.093”* 

.098*** 

.099*** 

.030* 

.054** 

.055** 

.062** 

.057** 

.056* 

.064* 

.065* 

Stic 

.003ns 

.012*** 

.013*** 

.017”* 

.016***  • 

.015** 

.018*** 

.020*** 

43®, 

.031** 

.057*** 

.059** 

.063”* 

.060** 

.060” 

.065** 

.065** 

52^  - 

.004ns 

.033* 

.034* 

.034ns 

.037ns 

.034ns 

.034ns 

.037ns 

ti4C 

.078*  •• 

.106*** 

.123*** 

.137*** 

.136*** 

.134*** 

.145*** 

.146*** 

71L 

.040*** 

.042*** 

.045*** 

.046*** 

.052*** 

.052*** 

.053*** 

.053*** 

82C 

.076* 

.051 

.084*** 

.087*** 

.096*** 

.095*** 

.096*** 

.097*** 

92B 

.054* 

.040ns 

.065* 

.072* 

.077ns 

.070* 

.081* 

.096* 

94B 

.053*** 

.083*** 

.091*** 

.110*** 

.102*** 

.101*** 

.117** 

.117*** 

95B 

.049*** 

.041*** 

.060*** 

.067*** 

.068*** 

.067*** 

.073*** 

.073*** 

ALL* 

.036*** 

.042*** 

.052*** 

.058”* 

.057*” 

.055— 

.060*” 

.062*** 

*  =  p<.05;  *•  =  p<.01;  ***  =  p<.001;  ns  =  non  significant 
All  22  MOS  for  which  there  were  SQT  scores  were  used. 
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Table  36 


Comparison  of  Models  Containing  "Best 
Subset  of  Predictors  by  MOS 
(All  Categories) 


MOS 


OSH 


IIB 


12C 


13B 


15E 


16R 


27F 


3U 


36C 


4SB 


51R 


52D 


64C 


68B 


71L 


71N 


Model  ComposMoti  and  Number 


MONO 


.119*** 


.149*** 


.075*  •• 


.051‘*» 


.201**‘ 


.133*** 


.136*** 


.009“* 


.120“* 


.062*  • 


.073*  •• 


.ISO*** 


•111** 


.144*** 


.079** 


.135*** 


.184*** 


.077*** 


.111*** 


.122** 


.105*** 


2 


.107*** 


.147*** 


.061*** 


.048*** 


.214*** 


.118*** 


.080’* 


.150*** 


.018*** 


.131*** 


.074** 


.127*** 


.171*** 


.105** 


.145*** 


.073* 


.078* 


.153*** 


.096*** 


.139*** 


.108*** 


.103*** 


MCEI 

NO 

MCEI 
NO  SI 

MCEI 

NOSP 

AFQT 

MCO 

NO 

AFQT 

MCEI 
NO  SI 
AFQT' 

MCEI  NO 
SISP 

AFQT 

3 

4 

5 

6 

7 

8 

.131*** 

.140*** 

.185*** 

.184*** 

.187*** 

.188*** 

.173*** 

.179*** 

.184*** 

.184*** 

.189*** 

.189*** 

.084*** 

.094*** 

.111— 

.110*** 

.116*** 

.116*** 

.061*** 

.065*** 

.068— 

.065*** 

.068— 

.071— 

.256*** 

.292*** 

.268*** 

.267— 

.300*** 

.300*** 

.153*** 

.161*** 

.168*** 

.166*** 

.172*** 

.174*** 

.082* 

.084* 

.110* 

.104— 

.111* 

.116* 

.166*** 

.168*** 

.209*** 

.209*  *• 

.217-* 

.217-* 

.019*** 

.023*** 

.023*** 

.021*** 

.025*** 

.026*** 

.142*** 

.145*** 

.185*** 

.185*** 

.193*** 

.193-* 

.086** 

.088** 

.088** 

.087- 

.089* 

.089* 

.141*** 

.144*** 

.141*** 

■.141*** 

.144*** 

.145*** 

.197*** 

.210*** 

.217*** 

.216*** 

.225*** 

.226*** 

•  111** 

.111* 

.111* 

.111* 

.112* 

.112ns 

.163*** 

.163*** 

.203*** 

.203*** 

.204*  •• 

.204*** 

.087* 

.110* 

.107* 

.104* 

.152- 

.154** 

.140- 

.163— 

.200*  •• 

.199*** 

.213*** 

.215*** 

.199— 

.204— 

.233— 

.233*** 

.234*** 

.234*** 

.102*** 

.103*** 

.109*** 

.104*— 

.107— 

.113-* 

.155*** 

.176*** 

.172— 

.172*** 

.187*** 

.187*** 

.142*** 

.151— 

.167*** 

.166*** 

.172*** 

.173*** 

.124*** 

.130*** 

.134*** 

.134*— 

.137*** 

.138*** 

*  =  p<.05;  **  =  p<.01;  ***  =  p<.001;  ns  =  nonsignificant 
All  22  MOS  for  which  there  were  SQT  scores  were  used. 


Standardized  regression  coefficients  and  adjusted  values  (Wherry  formula)  are ' 
provided  for  models  4,  6,  7,  and  8  in  Tables  37  through  39.  Again,  model  8  was  superior 
in  terms  of  shrunken  but  model  7  was  a  very  close  second  and  in  some  MOS  was 
equal  or  better  than  model  8.  Model  7  may  also  be  more  attractive  from  the  standpoint 
that  it  avoided  negative  coefficients  to  a  greater  degree  (particularly  negative  weights  for 
SP  itself  as  in  64C)  and  increased  the  weight  of  AFQT.  This  endorsement  of  model  7 
should  be  tempered  until  follow-up  analyses  are  performed  attesting  to  the  stability  of 
these  variables  (and  today’s  variants  of  them)  in  predicting  performance. 

Fairness.  In  addition  to  addressing  the  question  of  which  additional  predictors 
would  aid  in  the  selection  of  below  average  aptitude  recruits,  the- fairness  of  such  a 
model  is  also  of  concern.  More  specifically,  is  there  evidence  of  differential  prediction 
for  minority  groups?  Again,  though  fairness  was  approached  in  a  theoretically  similar 
manner  for  SQT  as  for  attrition  and  promotion,  separate  group  (i.e.,  black,  white)  OLS 
regression  analyses  as  opposed  to  contingency  tables  were  employed  for  SQT. 

Fairness  analyses  for  SQT  were  conducted  using  both  the  specified  14-variable 
model  3  and  the  reduced  5-variable  model  7  derived  from  the  best  model  analyses.  For 
Category  IIIB  and  IV,  as  well  as  Category  IV  soldiers  alone,  black-white  regression  slope 
and  intercept  differences  were  tested  within  MOS.  Regression  lines  for  white  and  black 
males  were  also  plotted.  Appendix  B  provides  a  tabulation  of  these  analyses.  There 
were  few  if  any  significant  slope  or  intercept  differences  and  where  such  differences  were 
significant  (e.g.,  IIB,  64C),  whites  generally  had  higher  criterion  scores  and  there  was 
overprediction  for  blacks.  Table  40  below  summarizes  the  fairness  results  of  model  7 
(AFQT,  MC,  El,  NO,  SI)  across  MOS  for  AFQT  Category  IIIB  and  IV  recruits.  Such 
results  were  typical  within  MOS  using  MOS-specific  coefficients. 
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Table  37 

P  Weights  and  Adjusted  Values  for  a  Subset 
of  Best  Models  by  MOS 

(Category  FV) 
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Table  40 


Fairness  Analyses  of  Model  7  (AFQT,  MQ  El,  NO,  SI) 
for  Category  MIR  &  IV  Soldiers  Across  MOS 


SPA  Fairness  Analyses  White/Black  Subgroups 

Across  All  SQT  MOS  Test:  SQT  Prediction  Composite -  Reduced  Model 

Sample:  Category  HUB  &  IV  Soldiers 


Standardized  Written 

SQT  Score 

Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept 

R-Square 

R 

Total 

46005 

98.734 

4.435 

98.622 

18.015 

0.998 

0.059 

0.060 

0.245 

White 

24069 

100.661 

4.316 

101.178 

17.556 

0.849 

15.711 

0.044 

0.210 

Black 

21936 

96.620 

3.503 

95.820 

18.096 

1.019 

-2.628 

0.039 

0.197 

Effect  Size 
Pvak/e 

0.911 

iiiiiill 

aooot 

aoool 

iiiiiiii 

Predictor  Score 

Predicted  Performance  Score 

standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Valua 

Undar/Over 

89.614 

NA 

88.689 

NA 

0.268 

NA 

NA 

92.029 

93.844 

91.150 

0.247 

0.197 

2.694 

Over 

93.117 

94.767 

92.258 

0.223 

0.169 

2.509 

Over 

96  346 

97  508 

Q554Q 

0156 

0.120 

1.960 

Over 

98.734 

99.536 

97.982 

0121 

0.140 

1.554 

Over 

100,123 

100.715 

99.397 

0.111 

0169 

1.318 

Over 

103.626 

103.689 

102.967 

0.134 

0.268 

0.723 

Over 

104.977 

104.836 

NA 

0.156 

NA 

NA 

NA 

109.293 

108.501 

NA 

0.247 

NA 

NA 

NA 

Predictor  Score 
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Chapter  5 

Expert  Judgment  Study 

Background 

The  focus  of  the  current  study  concerns  the  selection  and  classification  of  lower 
aptitude  soldiers.  As  previously  explained,  due  to  a  generally  favorable  recruiting 
environment  the  Services  have  not  had  to  access  such  individuals  in  some  time.  In  fact, 
the  last  period  when  significant  numbers  of  Category  IIIB  and  IV  personnel  were 
admitted  to  the  Army  was  1976-1980,  when  the  ASVAB  was  inadvertently  misnormed. 

A  dependence  on  historical  data  presents  some  limitations,  however,  that  the 
expert  judgment  portion  of  this  study  sought  to  overcome.  For  one  thing,  in  the  dozen- 
plus  years  since  the  misnorming,  the  ASVAB  has  evolved  so  that  a  number  of  the 
measures  included  at  that  time  are  no  longer  part  of  the  test.  Correspondingly,  there  are 
elements  in  the  current  ASVAB  that  were  not  in  existence  at  the  time  of  the  misnorming. 
A  means  must  be  found,  then,  to  capitalize  on  all  of  the  available  data  while  also 
addressing  the  current  realities  of  selection  and  classification.  Expert  judgments  offer  the 
possibility  of  evaluating  performance  predictors  even  when  empirical  data  are  lacking. 

Expert  judgments  concerning  criterion-related  validity  are  collected  by  presenting 
descriptive  information  about  a  set  of  predictors  and  job  performance  criterion  variables 
to  a  panel  of  persons  familiar  with  personnel  selection  and  classification.  These  experts 
then  assess  the  relationships  between  the  variables  by  estimating  the  value  of  the 
correlation  coefficients.  Studies  have  shown  that  pooled  expert  judgments  can  be  as 
accurate  as  empirical  research  using  samples  of  hundreds  of  subjects  in  evaluating  the 
validity  of  tests  (Schmidt,  Hunter,  Croll,  &  McKenzie,  1983). 

In  those  cases  where  there  is  validity  information  on  performance  predictors  for 
lower  ability  men,  the  accuracy  of  expert  judgments  can  be  assessed.  Correspondence 
between  the  actual  and  estimated  values,  provides  evidence  to  support  the  use  of  the 
expert  judgment  results  for  predictors  for  which  little  or  no  empirical  data  are  available. 
Thus  we  can  evaluate  the  whole  range  of  predictors  for  lower-ability  men,  and  provide 
the  Army  with  a  comprehensive  assessment  of  their  usefulness. 
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Method 


Participants.  The  judges  in  this  study  were  15  test  and  measurement  experts;  7 
from  the  U.S.  Army  Research  Institute  for  Behavioral  and  Social  Sciences  (ARI),  and  8 
from  the  Human  Resources  Research  Organization  (HumRRO).  In  addition  to  being 
knowledgeable  about  test  development  and  validation,  participants  were  selected  based 
on  their  familiarity  with  Army  policies  pertinent  to  the  present  study  (i.e.,  early 
separations,  SQT  development  and  administration,  and  promotion  and  reenlistment 
procedures). 

Procedures.  Participants  were  given  summary  information  concerning  the  19 
predictor  constructs  and  the  4  criterion  factors.  For  each  predictor,  the  information 
consisted  of  a  name,  definition  or  explanation,  brief  summary  of  the  typical  measures, 
reliability  and  validity  synopses  of  the  measure,  and  one  or  more  sample  items  (see 
Figure  28).  For  the  criterion  factors,  a  name  and  definition  or  description  were  provided, 
as  shown  in  Figure  29.  Appendix  C  contains  the  complete  summary  package. 

Judges  were  asked  to  provide  "true"  validity  estimates;  therefore,  a  review  of 
applicable  validity  issues  was  presented.  Specifically,  participants  were  reminded  of  the 
effects  of  criterion  unreliability,  range  restriction,  and  sample  size  on  the  relationship 
between  observed  and  true  validity. 

In  making  their  judgments,  the  experts  were  asked  to  follow  these  steps: 

1)  Review  the  summary  information  concerning  the  first  predictor  construct 
and  first  criterion  factor. 

2)  Provide  an  estimate  of  the  "true"  validity  (rounded  to  the  nearest  .05 
interval)  of  the  first  predictor  as  it  relates  to  the  first  criterion  for  Category 
IIIB  and  IV  personnel. 

3)  Repeat  step  two  for  Category  I-IILA  personnel. 

4)  After  reviewing  the  summary  information  for  the  second  criterion,  repeat 
steps  two  and  three  for  the  first  predictor  and  the  second  criterion. 

Continue  with  the  third  and  fourth  criteria. 

5)  Repeat  all  steps  for  the  next  (and  subsequent)  predictors. 
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CONSTRUCT  NAME:  Biographical  Information  CONSTRUCT  NUMBER:  7 

DEFINITION:  Measures  an  individual’s  background  and  life  experiences 

MEASURES:  Pencil  and  paper  forms  that  require  open-ended  or  yes/no 

responses  to  inquiries  about  an  individual’s  background  and 
life  experiences.  Biographical  Information  forms  may  also 
use  a  multiple  choice  format.  Sample  assessments  include 
the  Biographical  Information  Form  (BIF),  the  Biographical 
Information  Questionnaire  (BIQ),  the  Military  Applicant 
Profile  (MAP),  and  the  Armed  Services  Applicant  Profile 
(ASAP). 

RELIABILITY:  Correlations  of  .94  have  been  foimd  between  self-reported 

biodata  responses  and  later  verified  answers  to  the  same 
questions. 

VALIDITY:  OveraU  median  validity  coefficients  for  the  following 


criteria: 

•  Training  performance  .25 

•  Job  proficiency  .32 

•  Job  involvement  .30 

•  Adjustment  .26 


SAMPLE  ITEMS:  Military  Applicant  Profile 

•  From  the  time  you  first  started  school,  how  many  times 
did  your  family  move  from  one  house  to  another? 

a.  None  b.  1 

c.  2  d.  3 

e.  4  or  more 

•  How  old  were  you  when  you  first  began  to  support 
yourself  without  any  help  from  anyone  else? 

a.  16  or  younger 

b.  17 

c.  18 

d.  19  or  older 

e.  I  have  never  supported  myself 


Figure  28.  Predictor  Construct  Summary  Information 


131 


Attrition 

Attrition  is  defined  as  separating  from  the  Army  before  completion  of  the 
contracted  term  of  service  for  pejorative  reasons.  Attrition  for  nonpejorative 
reasons  such  as  disability,  death,  entry  into  officer  programs,  retirement,  secretarial 
authority,  sole  surviving  son,  or  breach  of  contract  by  the  Army  are  not  included 
in  this  criterion  factor. 

Early  separation  may  be  initiated  by  the  soldier  or  by  the  Army.  A  solider  may 
initiate  separation  procedures  through  administrative  procedures  (e.g.,  pregnancy) 
or  by  deserting.  The  Army  may  discharge  a  soldier  through  administrative  (i.e., 
medical,  homosexual,  or  disciplinary  chapters)  or  judicial  (i.e.,  court  martial) 
actions. 

Skill  Qualffication  Test  (SQT)  Score 

The  SQT  is  a  written,  multiple-choice  test  used  to  evaluate  a  soldier’s  technical 
knowledge  of  his  or  her  Military  Occupational  Specialty  (MOS)  and  skill  level 
proficiency.  Depending  on  the  MOS,  the  test  takes  approximately  two  hours  to 
complete,  and  all  soldiers  in  Skill  Levels  1  through  4  are  tested  annually  in  their 
primary  MOS.  The  SQT  is  scheduled  in  advance,  and  soldiers  are  allowed  to 
study  for  the  test. 

Promotion 

Advancement  in  the  Army  depends  on  factors  that  are  both  internal  and  external 
to  a  soldier’s  control.  Internal  control  factors  include  SQT  performance  and,  to 
some  extent,  supervisory  ratings.  External  control  factors  include  time  in  grade 
(e.g.,  soldiers  are  generally  awarded  the  rank  of  E2  upon  completion  of  basic 
training),  manpower  needs,  policy  decisions,  and  the  number  of  openings  within 
an  MOS. 

Reenlistment  Eligibility 

Reenlistment  eligibility  is  a  soldier’s  suitability  for  extending  his  or  her  time  in  the 
Army  beyond  the  initial  commitment.  It  is  often  used  as  a  summary  indicator  of 
success  in  the  Army.  Individual  achievements  as  measured  by  SQT  performance, 
supervisor  ratings,  and  promotions  influence  reenlistment  eligibility.  However, 
factors  outside  a  soldier’s  control  also  affect  reenlistment  eligibility  including 
manpower  needs,  policy  decisions,  and  the  number  of  openings  within  an  MOS. 


Figure  29.  Criterion  Factor  Summary  Information 
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After  providing  initial  validity  estimates,  judges  were  asked  to  estimate  the  "true" 
incrementEil  validity,  over  the  AFQT,  for  each  predictor-criterion  pair.  They  were 
instructed  to  follow  the  same  steps  outlined  above.  Finally,  participants  were  asked  to 
rank  order  the  top  10  predictors  for  each  criterion.  Rankings  were  to  be  made 
regardless  of  aptitude  level.  In  ranking  the  predictors,  judges  were  asked  to  assume  that: 
(a)  10  separate  regression  equations  would  be  written  for  each  criterion  factor,  (b)  only 
two  predictors  would  be  entered  in  each  equation-AFQT  and  one  other  predictor,  and 
(c)  AFQT  would  always  be  entered  first. 

Results  and  Discussion 

Validity  Estimates.  Descriptive  statistics  for  initial  and  incremental  validity 

estimates  are  presented  in  Tables  41  and  42,  respectively.  Although  participants  were 

/ 

asked  to  round  their  estimates  to  .05  intervals,  two  participants  did  not  do  so  in  a  few 
cases.  Therefore,  we  conducted  our  analyses  using  their  unmodified  raw  data. 

Overall,  the  standard  deviations  in  Tables  41  and  42  are  small,  which  indicates 
agreement  among  the  judges.  To  assess  this  directly,  interrater  reliability  was  calculated. 
First,  a  15  X  15  Pearson  correlation  matrix  of  the  judges’  responses  was  computed.  The 
values  were  then  converted  to  Fisher  z  correlations,  averaged,  and  converted  back  to 
Pearson  coefficients.  The  resulting  values  are  similar  to  single-rater  reliabilities  obtained 
in  generalizability  reliability  emalyses  (Brerman,  1983).  Using  the  Spearman-Brown 
formula,  the  single-rater  reliability  coefficient  was  stepped-up  by  15  raters  to  obtain  the 
interrater  reliability  coefficient  for  the  present  sample.  Using  this  procedure,  interrater 
reliability  is  .96  for  the  initial  estimates  and  .92  for  the  incremental  estimates,  indicating  a 
high  level  of  expert  agreement. 

Perhaps  the  most  striking  observation  from  Table  41  is  that  the  validity  estimates 
were  low,  ranging  from  .01  to  .36.  Acceptable  validity  coefficients  from  criterion-related 
validation  studies  range  from  .30  to  .40  (Muchinsky,  1983)*°.  jPurther,  recall  that  experts 
were  asked  to  provide  "true"  validity  estimates,  which  tend  to  be  larger  than  observed 
validities  (Callender  &  Osbum,  1981;  Pearlman,  Schmidt,  &  Hunter,  1980;  Schmidt  & 
Hunter,  1977).  Given  these  considerations,  the  mean  estimates  were  quite  low. 

See  Editor’s  Notes,  Note  5. 
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Table  41 

Mean  Initial  Validity  Judgments 


134 


/  Continued  / 


Table  41 

Mean  Initial  Validity  Judgments,  (continued) 
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Note. 


Table  42 

Mean  Incremental  Validity  Judgments 


/  Continued  / 


Table  42 

Mean  Incremental  Validity  Judgements  (Continued) 


The  fact  that  the  incremental  validity  estimates  were  also  low  (Table  42)  was  not 
unexpected.  This  result  indicates  that,  in  the  view  of  the  judges,  factors  tapped  by  the 
AFQT  explain  much  of  the  relationship  between  the  predictors  and  the  criteria. 

A  repeated  measures  ANOVA  was  done  to  test  the  mean  differences  between 
aptitude  levels  in  terms  of  estimated  predictor-criterion  differences.  The  concern  here 
was  with  differences  in  the  strength  of  the  relationships  more  than  the  direction. 
Therefore,  absolute  values  of  the  vahdity  estimates  were  used  to  calculate  the  ANOVAS. 
Tables  43  and  44  present  the  results  for  the  initial  and  incremental  estimates, 
respectively. 

The  results  showed  that  significant  differences  were  indeed  found  for  all  of  the 
main,  and  most  of  the  interaction  effects.  This  was  not  surprising  given  that  for  the  most 
part  the  various  criteria  tap  into  divergent  domains.  With  this  in  mind,  it  should  be 
noted  that  our  primary  concern  was  with  the  aptitude  by  criterion  by  predictor 
interactions.  That  is,  we  were  interested  in  differences  between  aptitude  groups  in  terms 
of  each  performance  measure  as  related  to  each  of  the  predictors  (e.g.,  are  education 
estimates  for  attrition  significantly  different  for  Categories  IIIB-FV  and  Category  I-IIIA 
individuals?). 

In  order  to  more  exactly  specify  the  effects  found,  critical  Tukey  values  were 
calculated  for  the  aptitude  by  criteria  by  predictor  interactions  for  both  the  initial  and 
incremental  estimates.  These  results  are  presented  in  Appendix  D.  Overall,  very  few 
differences  in  validity  estimates  were  found.  For  the  initial  estimates,  such  differences 
were  significant  for  only  three  predictors  (education,  interests,  and  marital  status/number 
of  dependents)  as  related  to  attrition.  For  the  incremental  estimates,  five  predictors 
(biographical  information,  education,  interests,  physical  fitness,  and  marital  status/number 
of  dependents)  showed  significant  aptitude  level  differences  for  attrition,  and  two 
(education  and  perceptual  speed  and  accuracy)  for  SQT  score.  Overall,  however,  these 
differences  were  rather  modest,  ranging  from  .02  to  .05.  Where  validities  were  judged 
different  across  aptitude  groups  for  a  given  predictor,  they  tended  to  be  slightly  higher 
for  below-average  recruits. 
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Table  43 

Repeated  Measures  ANOVA  Results  for 
Initial  Validity  Estimates 


Source 

imi 

df 

F 

P 

Aptitude 

393.68 

1 

5.23 

0.03 

Rater  x  Aptitude 

1053.35 

14 

Criterion 

16853.22 

3 

8.57 

0.00 

Rater  x  Criterion 

27532.75 

.42 

Predictor 

59606.18 

18 

8.34 

0.00 

Rater  x  Predictor 

100074.22 

252 

Aptitude  X  Criterion 

128.16 

3 

6.12 

0.00 

Rater  x  Aptitude  x  Criterion 

293.14 

42 

Aptitude  X  Predictor 

233.33 

18 

2.15 

0.00 

Rater  x  Aptitude  x  Predictor 

1518.00 

252 

Criterion  x  Predictor 

56493.12 

54 

11.80 

0.00 

Rater  x  Criterion  x  Predictor 

66914.52 

755 

Aptitude  X  Criterion  x  Predictor 

157.38 

54 

0.93 

0.62 

Rater  x  Aptitude  x  Criterion  x  Predictor 

2371.43 

755 
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Table  44 

Repeated  Measures  ANOVA  Results  for 
Incremental  Validity  Estimates 


Source 

SS 

df 

F 

P 

Aptitude 

278.60 

1 

6.60 

0.02 

Rater  x  Aptitude 

590.66 

14 

Criterion 

2073.56 

3 

4.05 

0.01 

Rater  x  Criterion 

7175.79 

42 

Predictor 

37440.43 

18 

10.76 

0.00 

■Rater  x  Predictor 

48719.68 

252 

Aptitude  x  Criterion 

59.10 

3 

3.22 

0.03 

Rater  x  Aptitude  x  Criterion 

256.91 

42 

Aptitude  x  Predictor 

108.95 

.  18 

1.29 

0.19 

Rater  x  Aptitude  x  Predictor 

1181.39 

252 

Criterion  x  Predictor 

14210.01 

54 

7.61 

0.00 

Rater  x  Criterion  x  Predictor 

26155.50 

756 

Aptitude  X  Criterion  x  Predictor 

166.37 

54 

1.49 

0.01 

Rater  x  Aptitude  x  Criterion  x  Predictor 

1558.48 

756 
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Given  the  relative  absence  of  judged  aptitude  differences,  validity  estimates  across 
AFQT  categories  (Categories  I-IV)  were  used  to  identify  the  best  predictors  for  each 
criterion.  Table  45  presents  Tukey  tests  of  differences  among  initial  estimated  validities 
for  each  of  the  19  predictors  for  attrition,  SQT  score,  promotion,  and  reenlistment 
eligibility.  Table  46  presents  Tukey  tests  for  the  incremental  validity  estimates  for  the 
four  criterion  factors. 

A  few  observations  based  on  these  tables  warrant  mention.  Within  each  criterion, 
ranking  the  predictors  in  descending  order  of  mean  validity  estimates  resulted  in 
approximately  the  same  order  for  both  the  initial  and  incremental  validities.  For  SQT 
score,  however,  there  was  some  flip-flopping.  Specifically,  ASVAB  subtests  ranked 
highest  for  the  initial  estimates,  whereas  non-cognitive  predictors  ranked  highest  for  the 
incremental  estimates. 

With  the  exception  of  SQT  noted  above,  non-cognitive  predictors  ranked  in  the 
top  five  for  all  criteria  for  both  initial  and  incremental  estimates.  Geographic  region 
consistently  ranked  at  or  near  the  bottom  in  all  cases. 

Predictor  Rank  Orders.  For  the  rank  order  task,  recaU  that  participants  were  to 
identify  and  rank  the  10  constructs  that  they  felt  were  most  predictive  of  each  of  the  four 
criterion  factors.  In  some  cases,  judges  provided  tied  rankings  (e.g.,  two  or  more 
predictors  were  labeled  "7"),  which  yielded  more  than  10  ranked  predictors.  When  this 
happened,  these  predictors  were  coded  the  midpoint  between  the  assigned  and  the  next 
higher  rank  (e.g.,  two  predictors  ranked  "T  were  rescored  7.5).  The  remaining  predictors 
were  coded  as  though  the  ties  never  occurred  (e.g.,  a  predictor  ranked  "8"  was  recoded 
"9",  a  predictor  ranked  "9"  was  recoded  "10").  The  unselected  predictors  were  coded 
"15",  the  midpoint  between  the  remaining  available  ranks  had  those  ranks  been  used. 

Table  47  presents  the  mean  predictor  rankings  for  attrition,  SQT  score, 
promotion,  and  reenlistment  eligibility.  A  close  examination  of  these  data  reveals  three 
commonalities.  First,  biographical  information,  education,  psychological  variables, 
physical  fitness,  and  interests  consistently  ranked  among  the  top  five.  Second,  predictors 
such  as  psychomotor  abilities,  spatial  ability,  and  perceptual  speed  and  accuracy  rounded 
out  the  top  10.  And  finally,  geographic  region  and  ASVAB  subtests  were  consistently 
ranked  the  lowest  among  the  predictors  (i.e.,  outside  of  the  top  10). 
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Table  45 

Tukey  Tests  of  Criterion  by  Predictor  Interactions 
Initial  Validity  Estimates 


Predictor 

Attrition 

Rank  Tukey 

Promotion 
Rank  Tik^ 

Reenlistment 
Rank  Tukey 

SOT 

Rank  Tukey 

Education 

1 

.316 

1 

.256 

1 

.248 

5 

.275 

Biographical  Info 

2 

.290 

4 

.190 

4 

.168 

.153 

Psychological 

3 

.281 

.233 

3 

.200 

ilili 

.136 

Interests 

4 

.233 

5 

.176 

6 

.148 

12 

.175 

Physical  Fitness 

5 

.203 

2 

.253  • 

2 

.228 

16 

.116 

Enlistment  Age 

6 

.192 

8 

.145 

11 

.112 

17 

.090 

Marital  Status/ 
Dependents 

7 

.124 

16 

.076 

17 

.085 

19 

.033 

Spatial  Ability 

8 

.101 

Bi 

.148 

10 

.116 

4 

.290 

Math  Knowledge 

.100 

5 

.176 

5 

.152 

1 

.365 

Mech. 

Comprehend 

.095 

6 

.173 

.138 

2 

.318 

Electronics  Info 

11 

.092 

11 

.133 

12 

.108 

7 

.235 

Psychomotor 

12 

.087 

15 

.103 

16 

.086 

13 

.158 

Perceptual  Speed 

13 

.086 

9 

.135 

14 

.100 

10 

.208 

Automotive  Info 

13 

.086 

13 

.126 

15 

.096 

8 

.230 

General  Info 

14 

.082 

7 

.148 

8 

.126 

9 

.226 

Shop  Information 

-15 

.080 

14 

.116 

.086 

11 

.205 

General  Science 

16 

.079 

10 

.134 

:M3  ;  ■  ■ 

.106 

6 

.251 

Numerical  Ops 

17 

.078 

12 

.129 

9 

.121 

3 

.300 

Geographic 

18 

.042 

.031 

18 

.031 

18 

.041 

NOTE:  Tukey  =  .0855,  Alpha  =  .05,  K  =  19,  MSE  =  88.628,  DFE  =  755,  N  =  30 
Within-criterion  differences  ^  .085  significant. 


142 


Table  46 

Tukey  Tests  of  Criterion  by  Predictor  Interactions 
Incremental  Validity  Estimates 


Predictor 

Attrition 

Rank  Tukey 

Promotion 
Rank  Tuk^ 

Reenlistment 
Rank  Tukey 

SQT 

Rank  Tukey 

Biographical  Info 

1 

.206 

4 

.106 

4 

.091 

llilll 

.081 

Psychological 

2 

.203 

2 

.148 

2 

.128 

5 

.081 

Education 

3 

.185 

3 

.107 

3 

.105 

2 

.102 

Interests 

4 

.156 

6 

.093 

5 

.081 

1 

.103 

Physical  Fitness 

5 

.148 

1 

.158 

1 

.150 

8 

.070 

Enlistment  Age 

6 

.128 

5 

.098 

6 

.080 

12 

.048 

Marital  Status/ 
Dependents 

7 

.094 

.053 

7 

.048 

14 

.013 

Psychomotor 

8 

.054 

mil 

.037 

10 

.031 

liliH 

.075 

Spatial  Ability 

miHi 

.046 

9 

.048 

6 

.040 

iilii 

.098 

Perceptual  Speed 

.031 

7 

.055 

9 

.038 

liillll 

.103 

Math  Knowledge 

IIIBI 

.029 

12 

.032  - 

10 

.031 

.070 

Numerical  Ops 

.028 

17 

.015 

16 

.015 

llill 

.043 

Automotive  Info 

13 

.025 

14 

.029 

15 

.018 

iiiiiil 

.066 

Electronics  Info 

.021 

15 

.026 

14 

.021 

7 

.071 

Shop  Information 

mil 

.020 

15 

.026 

13 

.023 

10 

.063 

Mechanical 

Comprehension 

15 

.020 

11 

.034 

11 

.026  ' 

4 

.086 

General  Info 

'  15 

.020 

13 

.030 

12 

.024 

11 

.053 

Geographic 

15 

.020 

18 

.003 

18 

.003 

15 

.006 

General  Science 

16 

.018 

16 

.023 

17 

.013 

12 

.048 

NOTE:  Tukey  =  .0534,  Alpha  =  .05,  K  =  19,  MSE  =  34.597,  DFE  =  756,  N  =  30 
Within-criterion  differences  ^  .055  significant. 
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Table  47 

Mean  Predictor  Rankings 


Predictor 

Attrition 

Rank  Mean  SD 

SOT  Score 
Rank  Mean 

SD 

Promotion 

Rank  Mean  SD 

Reeniist  Elia 

Rank  Mean  SD 

Biographical  Info 

1 

2.87 

1.46 

1 

530 

339 

1 

3.47 

2.20 

3 

3.90 

3.47 

Education 

2 

3.07 

2.43 

3 

6.67 

6.53 

4 

5.07 

3.99 

2 

3.8 

2.86 

Psychological 

Variables 

3 

3.37 

2.13 

2 

6.27 

4.84 

5 

6.60 

5.73 

5 

6.27 

5.68 

Interests 

4 

4.60 

233 

6.73 

4.00 

3 

5.07 

3.49 

4 

5.73 

3.34 

Physical  Fitness 

5 

5.26 

3.73 

n 

11.1 

5.63 

3.60 

2.41 

3.47 

2.32 

Age  at  Enlistment 

6 

6.33 

3.74 

17 

123 

4.51 

6 

8.47 

5.10 

6 

8.93 

4.85 

Marital  Status/No. 
Dependents 

7 

9.23 

4.97 

18 

13.9 

2.84 

9 

103 

5.19 

8 

10.0 

5.06 

Psychomotor 

Abilities 

8 

9.4 

3.80 

10 

103 

5.84 

7 

9.13 

5.48 

7 

9.13 

5.45 

Spatial  Ability 

9 

10.3 

3.41 

6 

8.00 

531 

10 

11.0 

4.76 

9 

10.2 

4.63 

Perceptual 

Speed/Accuracy 

liii 

12.6 

3.77 

7 

9.00 

4.91 

8 

10.5 

4.58 

11 

11.7 

4.41 

Math  Knowledge 

12.9 

3.91 

9 

10.4 

5.38 

14 

13.2 

3.78 

14 

12.6 

4.37 

Mechanical 

Comprehension 

12 

13.1 

3.33 

5 

7.20 

2.62 

11 

113 

3.77 

12 

11.7 

3.81 

Geographic 

Region 

13 

D.1 

3.45 

19 

15.0 

0.00 

18 

B.4 

3.46 

19 

14.2 

2.11 

Automotive 

Information 

14 

133 

2.90 

13 

112 

5.11 

16 

13.4 

2.82 

16 

133 

3.09 

Shop  Information 

15 

13.6 

2.41 

11 

11.0 

4.87 

17 

13.4 

2.89 

15 

13.1 

2.77 

General 

Information 

16 

13.7 

2.68 

14 

113 

4.47 

1 

11.9 

3.47 

10 

11.3 

3.71 

Numerical 

Operations 

17 

14.1 

2.49 

15 

11.9 

4.85 

19 

13.9 

3.00 

17 

14.0 

2.64 

Electronics 

Information 

-■"ill 

14.6 

134 

8 

9.53 

4.45 

13 

12.7 

2.89 

13 

12.5 

3.40 

General  Science 

19 

14.7 

1.29 

16 

123 

3.63 

15 

133 

338 

18 

14.0 

2.64 

Note: .  N  =  15 
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The  rank  orders  were  consistent  with  the  initial  and  incremental  validity  estimates 
presented  in  Tables  41  and  42  and  Tables  45  and  46,  Specifically,  the  non-cognitive 
predictors  with  the  highest-ranked  orders  also  tended  to  have  the  highest  mean  initial 
validity  estimates,  as  well  as  the  highest  incremental  validity  estimates.  A  number  of 
points  are  worth  making  in  this  regard.  First,  marital  status/number  of  dependents 
tended  to  be  ranked  higher  than  it  was  rated  as  a  predictor  of  attrition,  promotion  and 
reenlistment  eligibility.  Overall  there  was  less  agreement  concerning  "good"  predictors  of 
SQT  performance,  with  ASVAB  subtests  receiving  higher  ratings.  In  general,  though, 
there  was  substantial  agreement  between  the  predictor  ratings  and  ranks.  As  initial 
validity  estimates,  incremental  validity  estimates,  and  rank  orders  are  related  yet  different 
methods  of  obtaining  the  same  information,  it  was  encouraging  that  the  three  methods 
yielded  similar  results. 

Estimated  Compared  to  Empirical  Validities.  To  make  the  study  results 
generalizable,  recall  that  judges  were  asked  to  estimate  the  validity  of  predictors  that 
were  available  in  the  study  data  files  as  well  as  some  that  were  not.  Of  the  predictor 
constructs  in  the  expert  judgment  study,  only  five  were  not  included  in  the  database- 
geographic  region,  psychomotor  abilities,  psychological  variables,  and  biographical 
information.  Therefore,  to  compare  estimated  validities  with  actual  criterion-related 
validities,  correlations  were  computed  between  the  4  criterion  factors  and  the  15 
predictors  available  on  the  databases  for  Categories  I-IV.  These  correlations  are 
presented  in  Table  48  along  with  the  mean  estimates  of  the  judges.  Overall  it  was  clear 
that  the  experts’  validity  estimates  were  inflated  when  compared  with  the  actual 
correlations.  Again,  the  exception  to  this  rule  was  the  SQT.  In  this  case,  although  some 
of  the  estimates  were  higher,  the  judges  actually  underestimated  in  the  case  of  some  of 
the  ASVAB  subtests  (e.g.,  El,  GI,  and  GS).  There  is  clear  agreement  represented  in  the 
two  sets  of  figures  that  education  was  the  best  predictor  for  the  remaining  three  criteria. 
Even  here,  however,  with  the  exception  of  reenlistment  eligibility  (where  the  two  values 
are  nearly  identical),  the  estimates  provided  by  the  judges  were  substantially  higher  than 
the  actual  validities. 
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Table  48 

Comparison  of  Expert  Validity  Estimations  and 
Actual  Predictor/Criteria  Correlations  (Absolute  Values) 


Attrition 

Promotion** 

Beenlistment 

SQT 

Pre^ttofc^ 

Eligibility 

Experts  Actual 

Experts 

Actual 

I  Experts  Actual 

I  Experts  Actual 

Education 

32 

.24 

36 

.18 

35 

36 

37 

.04 

Enlistment  Age 

•19 

.01 

.14 

.04 

.11 

.03 

.09 

.01 

Marital  Status 

.12 

.04 

.08 

.03 

.08 

.02 

.03 

.03 

Electronics 

.09 

.04 

.13 

.08 

.11 

.07 

33 

.29 

Infonnation 

Gener^  Info 

.08 

.07 

.15 

.09 

.13 

.09 

33 

.26 

General  Sdence 

.08 

.07 

.13 

.10 

.11 

.10 

.25 

.29 

Mechanical 

.09 

.06 

.17 

.08 

.14 

.08 

32 

30 

Math  Knowledge 

.10 

.13 

.18 

.13 

.15 

.15 

36 

.28 

Numerical  Ops 

.08 

.09 

.U 

.10 

.12 

.10 

30 

.20 

Shop  Information 

.08 

.01 

.12 

.06 

.09 

.03 

.20 

.28 

Spatial 

.10 

.02 

.15 

.05 

.10 

.03 

.29 

.18 

Perception 

Automotive  Info 

.09 

.02 

.13 

.06 

.10 

.04 

.23 

.25 

Attention  to 

.09 

.05 

.13 

.05 

.10 

.05 

31 

.08 

Detail 

Interests 

.23 

.01 

.18 

.05 

.15 

.02 

.17 

.07 

Physical  Fitness 

.20 

.01 

.25 

.02 

.23 

.02 

.12 

.03 

’  Education  =  High  School  Grad/Nongrad;  AD  =  Attention  to  Detail  (actual),  Perceptual  Speed  and  Accuracy  (Judges);  Interests  = 
Sum  of  Administrative,  Electronics,  Mechanical,  and  Outdoors  Interest  measures;  Physical  =  Body  Mass  (actual).  Physical  Fitness 
(Judges). 

Actual  criterion  =  ever  promoted  to  E-5. 


Two  of  the  constructs-'physical  fitness  and  interests— were  consistently  judged  to 
have  substantially  more  predictive  power  than  they  appear  to  have  in  "real  life."  In  both 
of  these  cases  this  may  result  from  the  fact  that  there  is  some  disparity  between  the  data 
element  on  the  cohort  file  and  the  construct  as  presented  to  the  Judges.  Body  mass  may 
be  an  indicator  of  how  physically  fit  one  is,  but  it  also  does  not  cover  the  entire  domain 
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of  fitness  as  presented  to  the  judges.  Similarly,  the  general  concept  of  "interests"  may  not 
be  adequately  represented  by  the  available  data,  which  is  restricted  to  measures  of 
attitudes  towards  administrative,  electronics,  mechanical,  and  outdoor  pursuits.  Thus  two 
conclusions  concerning  the  use  of  expert  judgments  as  substitutes  for  actual  validity  data 
seem  warranted.  First,  there  needs  to  be  a  high  degree  of  correspondence  between  the 
construct  as  presented  to  the  judges  and  the  way  in  which  it  is  to  be  operationalized  for 
such  estimates  to  have  value.  Additionally,  to  the  extent  that  other  studies  have 
demonstrated  a  tendency  for  expert  judgments  to  be  inflated,  those  estimates  should  be 
either  subject  to  some  correction  for  inflation  or  used  in  a  relative,  rather  than  absolute, 
fashion  (e.g.,  rank  orders). 
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Chapter  6 

Summary  and  Conclusions 


From  these  many  analyses,  a  few  general  patterns  emerged.  As  volumes  of 
research  have  shown,  the  best  single  predictor  of  attrition  is  high  school  diploma  status. 
The  present  study  was  no  exception  to  this  long  standing  rule.  Not  only  was  diploma 
status  best  at  predicting  attrition  for  below  average  aptitude  personnel,  but  this 
demographic  or  background  variable  was  the  leading  contender  for  predicting  promotion 
to  E-4  as  well.  Age  at  entry  also  tended  to  add  significantly  to  the  prediction  of  both 
attrition  and  promotion  (particularly  the  latter),  albeit  not  nearly  so  strong  as  high  school 
graduation  status.  Generally,  the  ASVAB  cognitive  subtests  were  not  strongly  related  to 
either  leaving  service  prematurely  or  advancement  to  E-4,  although  the  speeded  subtests 
(AD,  NO)  and  less  "g"  laden  measures  (AI)  were  helpful  in  predicting  attrition  and 
promotion,  respectively,  in  a  multivariate  framework.  Education  credential,  together  with 
the  few  additional  significant  predictors  of  attrition  and  promotion,  had  greater  utility  for 
those  occupations  in  which  the  performance  of  lower  aptitude  individuals  has  been 
judged  to  have  high  utility  (e.g.,  IIB,  12C,  64C,  71L,  and  94B).  This  can  be  attributed  to 
the  generally  higher  rates  of  attrition  (and  lower  promotion  rates)  in  these  MOS.  Such 
performance  patterns  are  generally  found  in  jobs  of  low  complexity,  high  clerical  content, 
high  stress,  high  routinization,  and  low  variety  and  change,  regardless  of  aptitude  category 
(see  Rosenthal  &  Laurence,  1988). 

Unlike  the  more  "will  do"  criterion  measures  of  attrition  and  promotion,  SQT 
performance  was  more  readily  predicted  by  cognitive  subtests;  noncognitive  measures  and 
demographics  served  as  poor  predictors  of  this  "can  do"  criterion.  Even  for  lower 
aptitude  soldiers,  AFQT  emerged  as  a  significant  predictor,  attesting  to  its  importance  for 
selection.  However,  for  below  average  aptitude  personnel,  other  ASVAB  subtests  made 
even  more  of  a  contribution  to  SQT  prediction.  In  particular,  an  equation  comprising  El, 
SI,  MC  (cognitive  yet  vocationally  oriented  subtests)  NO,  and  AFQT  was  shown  to  be 
significant  across  and  within  all  MOS  (with  sufficient  sample  size)  under  study. 
Furthermore,  this  model  accounted  for,  on  average,  10  %  of  the  variance  across  MOS. 

A  larger  predictive  effect  was  found  in  MOS  such  as  15E,  64C,  and  94B.  Two  of  these 
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(15E  and  94B)  can  be  expected  to  have  relatively  low  utility  for  below  average  aptitude  ■ 
personnel  and  the  third  (64C)  is  a  high  density  MOS  that  can  be  expected  to  have  high 
utility  for  below  average  aptitude  soldiers.  The  additional  ASVAB  information  was 
rather  weak  (accounting  for  5  %  or  less  of  the  variance)  within  MOS  36C,  52D,  13B, 

12C,  and  71L,  even  though  the  individual  "best"  models  for  these  MOS  included  some  or 
most  of  the  predictors  in  the  overall  five-variable  best  model.  The  poor  predictive 
showing  for  the  composite  of  MC,  El,  NO,  SI,  and  AFQT  is  mitigated  to  some  extent  by 
the  fact  that  these  MOS  had  high  utility  for  poorer  performers  and  were  among  those 
where  below-average  aptitude  personnel  performed  best  in  terms  of  SQT.  In  other 
words,  there  was  less  variance  in  performance  to  be  accounted  for  in  such  occupations. 

The  empirical  results  were  corroborated  to  some  extent  by  the  results  of  the 
expert  judgment  study.  What  was  comforting  was  that  expert  opinion  and  empirical  data 
agreed  that  high  school  graduation  status  was  a  prime  predictor  of  attrition  and 
promotion.  Furthermore,  age  at  entry  was  among  the  best  predictors  according  to  both 
experts  and  empirical  results;  however  validity  estimates  were  much  higher  among  the 
former  than  the  latter  source  for  this  variable.  In  general,  higher  validity  coefficients 
were  expected  and  obtained  from  expert  judgments,  in  keeping  with  their  task  of 
providing  "true"  (i.e,  corrected  for  unreliability  and  range  restriction)  rather  than  actual 
validities.  Given  the  difference  between  some  of  the  construct  measures  judged  by  the 
experts  and  those  used  in  empirical  analyses  (e.g.,  physical  fitness  and  body  mass;  Army 
Vocational  Interest-Career  Examination  (AVOICE)  and  Army  Classification  Inventory 
(ACI)),  the  lack  of  congruence  between  experts  and  actual  data  is  quite  understandable. 
Physical  fitness  and  interest  measures  may  have  had  a  better  showing  in  the  empirical 
data  had  current  day  measures  been  used  rather  than  our  surrogate  measure  of  fitness 
(body  mass).  Similarly,  the  AVOICE  (with  a  multiple  choice  format)  might  have 
provided  better  results  for  an  interest  measure  than  the  ACI  (with  a  "yes/no"  format). 
Furthermore,  had  a  biographical  inventory  or  temperament  instrument  been  available  for 
empirical  analyses  in  this  data  set,  they  might  have  replaced  the  cognitive  measures  that 
appeared  in  many  of  the  best  empirical  models  for  predicting  attrition  and  promotion. 

The  experts’  confidence  in  biographical  and  temperament  measures  for  predicting 
attrition  and  promotion  was  notably  strong. 
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There  was  also  a  degree  of  convergence  between  expert  judgment  and  empirical  - 
data  in  the  case  of  SQT,  though  expert-provided  "true"  initial  validity  estimates  again 
were  considerably  higher  than  actual  simple  correlation  coefficients.  MC,  NO,  El,  and  SI 
were  among  the  top  ten  in  terms  of  estimated  validity  (excluding  expert-rated  measures 
that  were  not  used  in  the  empirical  analyses  such  as  MK).  A  major  divergent  finding  was 
that  experts  expected  high  school  graduation  status  to  be  more  highly  related  to  SQT 
than  was  found  to  be  the  case.  Expert  judgments  for  high  school  status  seem  erroneous 
in  light  of  policy  constrmnts.  Perhaps  the  experts  did  not  consider  (and  were  not 
explicitly  asked  to  consider)  that  those  of  lower  cognitive  ability  are  required  to  possess  a 
high  school  diploma  whereas  higher  AFQT  personnel  may  be  enlisted  without  one. 
However,  even  the  experts  judged  cognitive  ability  as  the  best  predictor  of  SQT 
(surmised  from  the  drop  in  validity  estimates  for  high  school  graduation  status  when 
AFQT  was  taken  into  account).  In  sum,  non-cognitive  variables  were  judged  the  best 
predictors  of  attrition  and  promotion,  whereas  cognitive  measures  received  the  most 
support  (from  both  judges’  ratings  and  empirical  results)  as  predictors  of  SQT 
performance. 

Relating  the  results  described  above  to  the  MOS  clustering  analyses  summarized 
in  Chapter  2  and  detailed  in  a  previous  project  report  (cf,  McCloy  et.  al,  1992)  is 
somewhat  risky,  because  the  jobs  selected  for  study  are  spread  across  the  23  Project  A 
clusters  and  the  20  clusters  devised  from  the  DOT  worker  traits  and  characteristics,  with 
some  clusters  having  no  representation.  Thus,  it  is  difficult  to  discern  trends  in  these 
data.  However,  the  types  of  MOS  in  which  lower  aptitude  soldiers  performed  relatively 
well  or  acceptably  were  in  keeping  with  expectations  and  findings  from  previous  studies 
(e.g.,  Greenberg,  1980;  Shields  &  Grafton,  1983;  also  cf.  McCloy  et  al.,  1992).  Although 
combat  MOS  and  jobs  involving  low  complexity  and  difficult  working  conditions  were 
found  to  have  high  attrition  and  low  promotion  rates,  these  findings  were  consistent 
across  AFQT  categories,  rather  than  being  limited  to  lower  aptitude  soldiers. 

Results  for  the  SQT  indicated  that  lower  aptitude  personnel  were  better  suited  for 
jobs  such  as  infantryman  (HB),  weapons  crewmember  (13B),  and  food  service  specialist 
(94B).  In  contrast,  these  soldiers  exhibited  relatively  poor  performance  in  MOS 
demanding  a  great  deal  of  reading  or  computation  such  as  administrative  specialist  (71L), 


151 


military  police  (95B),  or  jobs  involving  complex  equipment  operation  or  repair  (OSH, 

27F,  31J,  74D).  Though  a  definitive  pattern  across  clusters  was  difficult  to  discern,  MOS 
within  clusters  characterized  by  low  cognitive  complexity,  difficult  working  conditions,  and 
a  somewhat  high  stress  component  were  among  those  where  Category  IIIB  and  FV 
personnel  had  their  highest  standings  on  the  SQT  (i.e.,  IIB,  13B,  12C,  36C).  These 
results  are  concordant  with  those  of  Shields  and  Grafton  (1983)  who  found  lower 
aptitude  soldiers  performed  best  in  MOS  IIB,  16P,  19E,  and  13B  and  Greenberg  (1980) 
who  showed  IIB,  IIC,  16P,  12B,  13B,  and  62B  as  better  for  lower  aptitude  men.  There 
was  also  agreement  among  these  three  studies  that  certain  administrative  (e.g.,  71L, 

75D),  communications  (05C,  05H,  72E),  and  computer  operator  (74D)  jobs  were  among 
those  in  which  the  lower  aptitude  did  not  fair  well.  These  occupations  fell  in  a  single 
cluster  characterized  by  moderate  complexity  and  stress  levels,  more  or  less  pleasant 
working  conditions,  but  somewhat  high  or  sophisticated  human  interaction  (e.g., 
instructing).  In  contrast  such  job  characteristics  as  moderate  complexity  and  pleasant 
working  conditions  were  associated  with  lower  attrition  and  higher  promotion;  however 
this  was  the  case  across  the  categories.  Thus,  it  seems  prudent  to  let  SQT  performance 
provide  overriding  guidance  for  assignment. 

Though  decades  of  research  point  to  the  value  of  selecting  quality  recruits,  the 
present  study  provides  optimistic  suggestions  regarding  the  selection  and  placement' 
options  for  below  average  aptitude  recruits,  should  the  Army  need  or  wish  to  increase 
their  enlistment.  To  a  limited  degree,  certain  types  of  MOS  emerged  as  more  suitable 
for  lower  aptitude  soldiers.  Further,  the  DOT  clusters  based  on  worker  traits  and 
characteristics  appeared  useful  for  guiding  such  placement  decisions.  Low  cognitive 
complexity  would  appear  to  be  the  major  placement  factor.  Such  MOS  also  tend  to  be 
characterized  by  difficult  working  conditions.  Though  the  DOT  clustering  shows  some 
promise,  it  does  not  seem  to  be  fine  enough  to  make  unambiguous  placement  decisions. 
As  a  case  in  point,  cluster  17  comprises  jobs  that  were  among  the  best  (36C)  and  worst 
(31J)  risks  for  lower  aptitude  personnel.  The  MOS  in  this  cluster  tend  to  involve  dealing 
with  things  more  than  people,  are  moderately  complex,  have  difficult  working  conditions, 
and  involve  at  least  a  moderate  degree  of  stress  or  decision  making.  One  could 
speculate  that  though  there  are  a  few  exceptions  to  the  rule,  the  moderate  complexity 
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coupled  with  the  above  average  stress  levels  in  cluster  17  (which  is  dominated  by  repair 
occupations)  detract  from  their  suitability  for  below  average  soldiers.  More  intensive 
analyses  of  a  vidder  range  of  MOS  and/or  additional  clustering  strategies  are  required 
before  firm  conclusions  can  be  reached  concerning  the  assignment  of  lower-aptitude 
personnel  based  on  the  job-clustering  results. 

The  results  of  the  present  examination  of  predictors  also  provide  a  starting  point 
for  selecting  the  best  performing  lower  aptitude  soldiers.  There  is  room  for  additional 
variables  to  improve  the  prediction  of  performance  from  this  demand-constrained  group. 
The  existing  screen  of  high  school  graduation  status  shines  as  the  best  predictor  of  both 
attrition  and  promotion.  Though  other  demographic  variables  entered  the  best  equations 
for  some  MOS,  they  added  little  incremental  prediction  and  their  inclusion  may  stir 
controversy  (e.g.,  dependents)  if  used  in  an  operational  selection  mode.  Temperament 
or  biodata,  according  to  expert  opinion,  are  also  indicated  as  viable  predictors  that  may 
add  incremental  validity  over  and  above  graduation  status  for  such  "will  do"  criteria  as 
attrition  and  promotion. 

Though  demographics  did  not  predict  job  knowledge,  additional  ASVAB 
information  showed  promise  in  this  domain.  More  specifically,  subtests  such  as 
Numerical  Operations,  Mechanical  Comprehension,  Electronics  Information,  and  Shop 
Information  along  with  AFQT  seem  to  be  especially  attractive  predictors.  Together  with 
graduation  status  and  temperament,  these  variables  offer  a  good  starting  point  for 
developing  a  compensatory  screening  model  for  use  with  below  average  personnel  that  is 
fair  for  minority  group  members. 

From  an  historical  vantage  point,  this  study  provided  a  wealth  of  information  to 
inform  selection  and  placement  decisions  regarding  those  of  below  average  aptitude. 
Though  there  may  be  questions  concerning  the  use  of  yesterday’s  predictors  and  criteria 
to  make  selection  decisions  for  today,  these  data  offer  valuable  lessons  from  a  period  in 
Army  history  when  lower  aptitude  soldiers  were  not  a  possibility  but  a  reality.  In 
contrast.  Annex  B  offers  a  glimpse  of  selection  and  classification  decisions  for  lower 
aptitude  recruits  on  the  basis  of  a  simulated  sample  using  not  only  today’s  but  tomorrow’s 
measures  which  were  unavailable  for  direct  analysis  in  the  present  study.  From  all  of  this 
information,  the  Army  is  indeed  in  a  better  position  for  making  practical  decisions  for  the 
selection  and  placement  of  the  best  lower  aptitude  personnel. 
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EDITOR’S  NOTES 


1.  “Below-average”  refers  in  this  context  to  someone  who  receives  a  below  average 
score  on  the  AFQT.  No  broader  meaning  is  intended. 

2.  See  Preface  for  a  discussion  of  the  use  of  the  expression  “low  aptitude  personnel”  in 
this  report. 

3.  Policies  on  the  admission  of  females  has  changed  substantially  since  the  time  these 
data  were  gathered.  Thus,  there  was  a  concern  that  any  conclusions  drawn  from  the 
female  soldiers  included  in  this  database  would  not  be  easily  generalizable  to  the  female 
soldiers  of  today.  Accordingly,  the  analyses  were  conducted  only  on  males,  and  the 
conclusions  drawn  apply  only  to  males. 

4.  The  terms  “high  utility  MOS”  and  “low  utility  MOS”  have  a  strict  meaning,  described 
on  page  14  on  the  paragraph  headed  “Project  A  Utility  Values.”  No  broader  statement 
about  the  utility  of  these  MOS  is  intended. 

5.  This  statement  is  intended  to  provide  broad  guidance  for  interpreting  validity 
coefficients.  It  should  be  understood,  however,  that  the  absolute  level  of  a  validity 
coefficient  should  not  be  the  only  consideration  in  judging  the  utility  of  a  predictor. 
Under  the  appropriate  circumstances,  measures  with  lower  validity  coefficients  may  well 
be  desirable  candidates  for  operational  use. 
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PREDICTOR/CRITERION  CORRELATIONS 
AND  PREDICTOR  INTERCORRELATIONS 


Bivariate  Predictor/Criterion  Correlations  Across  25  MOS 
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Intercorrelation  Matrix  of  Predictors  Across  25  MOS 
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Appendix  B 

FAIRNESS  ANALYSES 
14- VARIABLE  MODEL  3  AND 
5-VARIABLE  REDUCED  MODEL  7 
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SPA  FAIRNESS  ANALYSES 


CATEGORY  IV  SOLDIERS 
Model  3 
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NA 

NA 

NA 

SPA  Fairness  Analyses  ;  White/Black  Subgroups 

SQT  MOS=  16R  Test:  SQT  Prediction  Composite -  Model  3 

Sample::?  CategoryIV  Soldiers 


Standardized  Written  SQT Score 


Group 

Total 

White 

Black 

Effect  Sae 

P  vs/ere 

Predictor  Score 

81.409 

85.034 

86.799 

90.882 

94*357 

97,573 

102.578 

102.969 

108.426 


Test 

Test 

Criterion 

Criterion 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square  R 

532 

94.357 

6.051 

94.245 

20.160 

1.017 

-1.714 

0.093  0.305 

254 

96.730 

5.848 

96.995 

19.902 

0.990 

1.187 

0.085  0.292 

278 

92.189 

5.390 

91.731 

20.101 

0.997 

-0.193 

0.072  0.268 

0.750 

BISlililili 

0.26t' 

_ _ _  txssaz  0-676& 

s'A%'^MvC5ss<  ••  w.'.sv  N  <%  %  %  v< 

Predicted  Performance  Score 

Standard 

Error 

W-B  Score  Olfference. 

White 

Black 

White 

Black 

Valua 

Undar/Ovar 

NA 

80.972 

NA 

2597 

NA 

NA 

85.371 

84.586 

2671 

1.930 

0.785 

Over 

87.118 

86.346 

2354 

1.642 

0.772 

Over 

91.160 

90.416 

1.683 

1.195 

0.744- 

Over 

iPiliilHHi 

94.600 

93L8B1 

1  289 

1.252'. 

0.720' 

Over" 

97-790 

97.093' 

1207 

1.642 

0.697 

Over 

10Z739 

10Z077 

1.689 

2522 

0.662 

Over 

103.126 

102467 

1.747 

2597 

0.659 

Over 

108.529 

NA 

2671 

NA 

NA 

NA 

SPA  Fairness  Analyses  White/Black  Subgroups:?  ?  ? 

SQT  MOS  S:  SeGS;:  Test::  SQp;Frediction:Gomposite>^  Models 

Sarnpie;:'???.’::::Categoryi:|V::Soidlers»::::::: 


Standardized-Wntten  SQT  Score: 

Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square 

Total 

1356 

99.723 

2.736 

99.786 

19.606 

0.992 

0.910 

0.019 

White 

312 

101.221 

2.778 

102737 

17.935 

1.231 

-21.887 

0.036 

Black 

1044 

99.273 

2.559 

98.904 

20.002 

0.777 

21.759 

0.010 

Effect  Size 

0.712 

0196 

Pyahe 

0.3244 

0.1118 

Predictor  Score 

Predicted 

Performance  Score 

Standard 

Error 

W-B  Score  Olfference 

White 

Black 

White 

Black 

Valua 

Undar/Ovar 

94.155 

NA 

94.917 

NA 

1.377 

NA 

NA 

95.665 

95.877 

96.091 

2229 

1.065 

-0.214 

Under 

96.714 

97.168 

96.906 

1.900 

0.871 

0.262 

Over 

9S.443 

iiiimi 

99*298 

98  249 

1410 

0648- 

1  047 

Over 

99.723 

100872 

99:244 

1  133 

0.625 

1.628 

Over 

101.832 

103.468 

100882 

1021 

am 

2586 

Over 

103.999 

106.136 

102566 

1.410 

1.294 

3.570 

Over 

104.391 

106.618 

102871 

1.513 

1.377 

3.748 

Over 

106.777 

109.555 

NA 

2229 

NA 

NA 

NA 

94  96  99  100  102  104  106  108 

Predoer  Score 
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SPA  Fairness  Analyses  White/Bfiack  Subgroups 

SQT^  MOS:=  43E::  T^t::  SQTiPrediction  Composite  —  Model  3 

Samplers 

Standardized  Written  SQTScore^ . 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square  R 

Total 

174 

91.691 

5.424 

91.902 

18.574 

0.966 

3.342 

0.080  0.283 

White 

105 

92.538 

5.306 

92701 

18.268 

1.130 

-11.829 

0.108  0.329 

Black 

69 

90.403 

5.385 

90.688 

19.099 

0.725 

25.154 

0.042  0.205 

EfTed  StZB, ' 

0.394"" 

atD8' ' 

^  ^  ■tv'f  w  wc  <«K^^%vc  w.  <*3dfetwfcci*cv  Q»'^^39S  >■  Q«S86(X 

Predictor  Score 

Predicted 

Performance  Score 

Standard  Error 

W-B  Score  Difference. 

WhKa 

Black 

White 

Black 

Value 

Under/Over 

79.633 

NA 

82888 

NA 

5.032 

NA 

NA 

81.926 

80.747 

84.550 

3.765 

4.197 

-3.803 

Under 

85.018 

84.241 

86.792 

2921 

3.183 

-2.551 

Under 

37-232. 

86.743" 

88.397 

2381 

2612 

-1  654 

Under 

9t-e9f . 

91.782. 

91.630 

1.705 

2314' 

0.162  ' 

;Ovef' 

^788 

9a41T' 

94600 

1.975 

3183 

1  811 

Over 

97.844 

98.735 

96.091 

2381 

3.839 

2644 

Over 

101.173 

102496 

98.504 

3.216 

5.032 

3.992 

Over 

103.150 

104.730 

NA 

3.765 

NA 

NA 

NA 

• 

3 

jwNto 

« 

^  M 

. 

60 

71 

S  60 

69  90  »3  too  105 

Prvidbar  Scone 

SPA  Faimess:Anaiysesi 

White/Black  Subgroups 

SQSMGS  = 

Test: 

SQTPrediction  Composite  ~  Model:  3 

Sample::: 

Category  IV  Soldiers 

Standardized  WnftemSQTScorer< 

Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square  R 

Total 

4089 

94.872 

5,997 

94.925 

16.966 

0.998 

0,190 

0.125  0.354 

White 

1920 

98.069 

5.513 

98.431 

16.929 

0.844 

15.643 

0,076  0.276 

Black 

2169 

92.042 

4.881 

91.822 

16.389 

1.103 

-9.657 

0.108  0.329 

Effecf  Stze 

1  005 

0  390 

Pvahjg 

0.0071 

0.1702' 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

82.280 

NA 

01.098 

NA 

0.743 

NA 

NA 

87.043 

89.107 

86.351 

0.830 

0.476 

2.756 

Over 

87.161 

89.207 

86.482 

0.823 

0.470 

2.725 

Over 

92.558- 

'  93.760 . 

92432 

0J525' 

0.334 

1.328 

Over 

94.872 

95.715 

94.987 

0  429.; 

D.3S4 

0.728 

Over 

96.923' 

97.446 

97.249 

0379 

0.470 

0.197 

Over 

101.804 

101.566 

102.633 

0,449 

0.743 

-1.067 

Under 

103.582 

103.066 

NA 

0.525 

NA 

NA 

NA 

109.095 

107.719 

NA 

0.830 

NA 

NA 

NA 

SPA  Fairness  Analyses  White/BIaek.Subgroups 

SQTv  MOS;-  71L  Test:  SQTjPrediction  Composite - 

Sample;..  Category  IV  Soldiers 


Standardized  Written  SQT Score 


Group 

N 

Test 

MN 

Test 

SD 

Criterion  Criterion 

MN  SD  Slope 

Intercept  R-Square 

R 

Total 

626 

91.907 

3.996 

91.532  17.252  0.966 

2766 

0.050 

0.224 

White 

137 

92.813 

4.261 

91.963  18.303  0.997 

-0.599 

0.054 

0.232 

Black 

489 

91.653 

3.886 

91.411  16.963  0.965 

2.982 

0.049 

0.221 

Effect  Sae 

0.290; 

0032" 

vshiB  ^ 

V.  >>  ^ 

■»  «  s  %  % 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Valua 

UndarTOvar 

83.881 

NA 

83.927 

NA 

1.673 

NA 

NA 

84.291 

83.439 

84.323 

3.401 

1.603 

-0.884 

Under 

87.767 

86.905 

87.677 

2357 

1.058 

-0.772 

Under 

88.652  ' 

"  87.6S7~ 

88.4;^ 

'2151 

0.a57 

-0.747 

Under'' 

91.907 

91.032:: 

91.672. 

1.655. 

D7S0 

-0J84Q;; 

UndSBi-',' 

95.539 

„  ,.94.653 

95.177 

T.80a 

1.058 

-0.524 

Under"' 

97.074 

96.184 

96.658 

2151 

1.284 

-0.475 

Under 

99.425 

98.528 

98.927 

2808 

1.673 

-0.399 

Under 

101.335 

100.432 

NA 

3.401 

NA 

NA 

NA 

SPA  Fairness  Analyses 
SQTMOSss  82C" 


White/Black  Subgroups 

Test:  SQ.T  Prediction  Composite  »  Model  3 

Sample: '  Category  iV  Sc^dlers. 


'  ''  s  **  ^NT  s  ^  :s|^«w>y.«y.gy^.,\ss  ^aO.  <\<  \  ss  t 

Standardized Wntten SQTScore-* 

Test 

Test 

Criterion  Criterion 

Group 

N 

MN 

SD 

MN  SD 

Slope 

Intercept  R-Square 

R 

Total 

447 

94.633 

5.757 

94.504  17.059 

1.021 

-2.118 

0.119 

0.345 

White 

250 

95.734 

5.S54 

97.250  17.021 

1.087 

-6.801 

0.140 

0.374- 

Black 

197 

93.235 

5.326 

91.020  16.502 

0.738 

22.224 

0.057 

0.239 

Effect  Saa 

0.434 

0.3^ 

Pvakra 

A  '•%'  %•.  <V 

'02043 

00135 

Predictor  Score 

Predicted  Performance  Score  Standard  Error 

W-8  Score  Difference 

White 

Black 

White 

Black 

Valua 

Undar/Ovar 

82583 

NA 

83.170 

NA 

2553 

NA 

NA 

84.026 

84.535 

84.235 

2232 

2280 

0.300 

Over 

87.909 

88.756 

87.101 

1.667 

1.615 

1.655 

Over 

89880 

90.899 

88.5S 

1.412 

1.349 

2343 

Over 

94.633 

9a06S 

92063 

-t.Dte,"' 

1  160 

4.002 

Over 

9^561 

100.335 

94.962 

1.109 

1  615 

5.373' 

Over 

101.588 

103.625 

97.196 

1.412 

2.124 

6.429 

Over 

103.887 

106.124 

98.893 

1.712 

2.553 

7.232 

Over 

107.442 

109.988 

NA 

2232 

NA 

NA 

NA 

60 


65 


90  05  100  105  110 
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SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  94B  Test:  SQT  Prediction  Composite  -  Model  3 

Sample:  CategorytV:  Soldiers 


Test 

Test 

Criterion  Criterion 

Group 

N 

MN 

SD 

MN  SD 

Slope 

Intercept  R-Square  R 

Total 

2531 

96.165 

6.350 

96.199  18.262 

0.994 

0.576 

0.120  0.346 

White 

781 

100.310 

6.330 

100.851  17.414 

1.014 

-0.866 

0.136  0.369 

Black 

1750 

94.315 

5.419 

94.123  18.254 

0.934 

6.023 

0.077  0.277 

E77M  Size 

'  0;S44'' 

Q.38&'>s"' 

liffiPiS 

PVfihig 

0:.51Se 

'  0.2483 

Predictor  Score 

Predicted  Performance  Score  Standard  Error 

W-B  Score  Difference. 

Whita 

Black 

White 

Black 

Value 

Undar/Ovtr 

83.477 

NA 

83.991 

NA 

0.937 

NA 

NA 

87.650 

88.011 

87.888 

1.295 

0.665 

0.123 

Over 

88.896 

89.275 

89.052 

1.194 

0.593 

0.223 

Over 

93.98Q 

f  *  ft* 

94.430 

93.800 

Q.Bt9 

Q.'42a'  ' 

0.629,  ' 

Over- 

95.165 

96.645 

95.841 

.  »  ™  0692 

0.443 

0.804.' 

Over,  "  - 

93.734 

J00.264/ 

99.175// 

„1.„ . '„.„,0.582 

0593" 

1.090 

Over 

105.153 

105.759 

104.238 

0.729 

0.937 

1.523' 

Over 

106.640 

107.287 

NA 

0.819 

NA 

NA 

NA 

112.970 

113.688 

NA 

1.295 

NA 

NA 

NA 

w. 


SPA  Fairness,  Analyses  White/Black  Subgroups 

SQT  MOS-  S5B  TesU-  SQ.T  Prediction:  Composite —  Model  3 


Sample: 

Cate^ry  lV  Soldiers  - : 

Standardized 

Writte 

IT  SQT  Sc 

ore'"*'.  , 

Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

D 

Total 

1500 

91.734 

4.108 

91.717 

18.132 

1.041 

-3.777 

0.056 

0.237 

White 

969 

92875 

3.886 

92596 

18.430 

1.158 

-14.970 

0.060 

0.245 

Black 

531 

89.651 

3.666 

90.113 

17.479 

0.936 

6.198 

0.039 

0.197 

Effect  Size-  - 

0.785 

0137 

P  va/ua 

,  33833 

0.3226 

Predictor  Score 

Predicted  Performance  Score 

Standard 

Error 

W-B  Score  Difference 

White 

Black 

White 

Bleck 

ValiM 

Under/Ovcr 

82319 

NA 

83.249 

NA 

1.663 

NA 

NA 

85.103 

83.579 

85.854 

1.284 

1.185 

-2275 

Under 

85.985 

84.601 

86.680 

1.168 

1.052 

-2079 

Under 

88.989 

88.079 

83.492- 

3812 

3756 

-1.412  '  , 

Undar- 

91.734 

91.258 

920Bt 

a596 

3855 

-0803 

Under 

93317 

'  93.09t,  ' 

33.543" 

0.57^"'. 

ttOZ" 

-0.452 

Under 

96.761 

97.079 

96.766 

0.812 

1.623 

0.313 

Over 

96.983 

97.336 

96.974 

0.835 

1.663 

0.362 

Over 

100.647 

101.579 

NA 

1.284 

NA 

NA 

NA 

SPA  FAIRNESS  ANALYSES 


CATEGORY  IIIB  &  IV  SOLDIERS 
Model  3 
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Sl^  Fairness  Analyses®:®  WhiteiBlackiSubgroups  ;:  ® 

saTMOS=11B  Test:  ®  sSQlsFredictioirGomposite  ^  Model  3 

Sample;  Category  IIIB  SIV  Soldiers 


Standardized  Written  SQT  Score  '  -  '  ' 

Test 

Test 

Criterion  Criterion 

Group 

N  MN 

SO 

MN  SO 

Siope 

Intercept  R-Square 

R 

Total 

17550  100.680 

5.699 

100.495  17.579 

1.012 

-1.397 

0.108 

0.329 

White 

102ra  102.591 

5.663 

103.102  16.915 

0.891 

11.665 

0.089 

0.298 

Black 

7275  97.981 

4.542 

96.813  17.840 

1.065 

•7.509 

0.074 

0.271 

Effect  Saa 

0803 

^  0.^' 

Pvahfe 

ks-.v.w.w.‘.vvkv\v.\v.v»vi»^ 

aoooeu,..  o-ooihw« 

Predictor  Score 

Predicted  Performance  Score  Standard  Error 

W-B  Score  Oifference 

White 

Black 

White 

Black 

Valua 

Undar/Ovar 

88.897 

NA 

87.166 

NA 

0.450 

NA 

NA 

91.265 

92982 

89.688 

0.356 

0.359 

3.294 

Over 

93.439 

94.919 

92004 

0.303 

0.285 

2916 

Over 

96.S28" 

95.01^ 

95.719 

0.225 

0.207 

2309. 

Over ' 

toa.6so 

1Qt.371 

99715 

0168 

0234 

1  666 

Over  • 

102.523 

103013" 

101.678';  .. 

0.158 

0285 

1  335 

Over' 

107.065 

107.060 

106.515 

0.203 

0.450 

0.545 

Over 

108.254 

108.119 

NA 

0.225 

NA 

NA 

NA 

113.917 

113.165 

NA 

0.356 

NA 

NA 

NA 

SHA  Fairness  Analyses 
SQTMOS:=  12G?:: 


Wliite/Btack  Subgroups 

Test;^^®  SQT  Fredliction:  Composite  -  Model  3 

Sample;®®:  Category^lllB  S  IV  Soldiers 


Standardized  Written  SQT  Score 


Test 

Test 

cnterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SO 

Slope 

Intercept 

R-Square 

R 

Total 

642 

98.697 

3.644 

98.506 

16.098 

1.033 

-3.468 

0.055 

0.235 

White 

510 

99.498 

3.454 

■  99.620 

15.479 

0.817 

18.356 

0.033 

0.182 

Black 

132 

95.605 

2547 

94.202 

17.709 

1.909 

-88.303 

0.075 

0.274 

Effect  Size 

1.068 

,  QJSST' 

p  yshie 

W^M 

IPlimillllll 

Ullili-iiiw 

aoK9 

0.3117 

iPiliffijPii 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W'B  Score  Oifference 

White 

Black 

White 

Black 

Valua 

Undar/Ovar 

90.511 

NA 

84.482 

NA 

3.315 

NA 

NA 

92590 

94.002 

88.451 

1.507 

2297 

5.551 

Over 

93.058 

94.384 

89.345 

1.426 

2096 

5.040 

Over 

96.044-" 

g®i|iS5S: 

'  95.824 

950^ 

0^3 

1.504 

1.779 

Over ' 

98697 

98991 

108110  ' 

8692 

2.332' 

-1.118 

Under 

98152. 

98546 

980^ 

0.723 

2CS6 

-0.523 

Under 

100.699 

100.627 

103.931 

0.714 

3.315 

-3.304 

Under 

102952 

102468 

NA 

0.953 

NA 

NA 

NA 

106.406 

105.290 

NA 

1.507 

NA 

NA 

NA 

90  92  94  96  96  100  102  t04  108  100 
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S PA  Fairness  Analyses  Wftiti^Brack  Subgroups 

SQT^  MOS  =  13B  g  Test:  SQUPrediction  Composite -  Model;3 

^  ;  Category  tllB  a  IV  Soldiers:  : 


StandardiiedWritten  SQT  Score  ^  ” 

•itx'tv'txt--' 

Test 

Test 

Criteiton 

Criterion 

i  I 

Group 

N 

MN 

SO 

MN 

SO 

Slope 

Intercept  R-Square 

R 

Total 

9868 

99.348 

4.012 

99.237 

18.176 

1.001 

-0.230 

0.048 

0.221 

White 

4038 

101.139 

4.122 

101.148 

18.161 

0.944 

5.875 

0.046 

0.214 

Slack 

5832 

98.109 

3.425 

97.914 

18.071 

1.037 

-3.884 

0.039 

0.197 

BTecl  Size-  -  ; 

0.765,  " 

iti'iSS::':  it 

0178 

•'.vTvk  •*.* . 

P  valve 

<%s  sv.< 

-v.^  N  >  , 

.^VaVWVWVW\W«^>AV^V'. 

%«-*  \  <  vv.  s%  <  «  < 

03296 

'  05827; 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

Whit* 

Black 

Whit* 

Black 

Value 

Undar/Ovar 

91.259 

NA 

90.772 

NA 

0.519 

NA 

NA 

9Z895 

93.368 

9Z468 

0.624 

0.423 

0.900 

Over 

94.684 

95.057 

94.323 

0.519 

0.328 

0.733 

Over 

97.017  ' 

97.2^, 

96.743'  ■ 

0335  ' 

0.24S 

0.516 

Over 

98.348;,  , 

99.46Qi, 

99-ie0„„ 

0304  -  - 

0.247 

0.300, 

Over 

101'.534  ' 

I0t:523 

IOt.427;"" 

0.280/ 

0.325 

0.095=’ 

Oven  ' 

104.959 

104.756 

104.978 

0.381 

0.519 

-0.222 

Linder 

105.261 

105.041 

NA 

0.395 

NA 

NA 

NA 

109.383 

108.933 

NA 

0.624 

NA 

NA 

NA 

SPA  Fairness  Analyses  White/Black  Subgroups  : 

SQT  MOS »  15E  Test:  SQTi  Predictiort  Composite  -  Models 

Sampler  Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQTScore  « 

Test 

Teat 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

293 

90.699 

9.008 

90.600 

18.127 

0.978 

1  887 

0.236 

0.486 

White 

186 

94.666 

7.080 

95.488 

17.202 

0.722 

27,110 

0.088 

0.297 

Black 

107 

83.802 

7.772 

8Z102 

16.551 

1.031 

-4,263 

0.234 

0.484 

Effect  Sfza 

1,206 

0.738 

P  valve 

0.2308 

'  0-0781 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

Whita 

Black 

White 

Black 

Valua 

Undar/Ovar 

68.258 

NA 

66.111 

NA 

3.131 

NA 

NA 

76.030 

NA 

74.124 

NA 

1.980 

NA 

NA 

80.506 

85.235 

78.739 

2693 

1.521 

6.497 

Over 

87-588 

90.347 

86.038- 

1-703 

1.^ 

4.309'; 

Over- 

saesg 

92.595 

88.2.48,„'' 

1.3S1', 

1  872 

3.347' 

Over 

91-574 

93.226 

96150 

1.314' 

1.980' 

3.077' 

Over 

99.346 

98.838 

98.163 

1.444 

3.131 

0.675 

Over 

101.746 

100.571 

NA 

1.703 

NA 

NA 

NA 

108.826 

105.682 

NA 

2.693 

NA 

NA 

NA 

SPMFaiiiness  Analyses  Whlte/BIackiSubgroups 

SQT  MOS-  16R  Test:  SQ^Prediction  Composite -  Model  3 

Sample:  Category  IIIB  4 IV- Soldle»^.  -  ^ 


sv.s-.y.yAvC‘."‘'^'\  •’ 

SN  V 

s<  %..>SyV  ss  s 

Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

615 

95.826 

6.834 

95.699 

19.705 

1.014 

-1.460 

0.124 

0.352 

White 

318 

98.654 

6.707 

99.040 

18.994 

0.972 

3.123 

0.118 

0.344 

Black 

297 

92.798 

5.561 

92122 

19.856 

0.982 

0.952 

0.076 

0.276 

SJ&dtStt8' 

0.B57  ' 

Qjssr' 

Predictor  Score 

Predicted 

Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Undar/Ovar 

81.676 

NA 

81.158 

NA 

2476 

NA 

NA 

85.240 

85.976 

84.658 

2237 

1.869 

1.319 

Over 

87.237 

87.917 

86.619 

1.975 

1.566 

1.299 

Over 

St.a47  ' 

92.4» 

81.244 

1.415 

1.120 

1.252 

Over 

95L82S.. 

96:268 

95053 

1  C»8 

1.2S1 

1.213' 

Over 

98.359 

98.728 

97.54t 

toot' 

1.566 

1.187 

Over 

103.920 

104.133 

103.001 

1.272 

2.476 

1.132 

Over 

105.361 

105.534 

NA 

1.415 

NA 

NA 

NA 

112.068 

112.053 

NA 

2.237 

NA  ■ 

NA 

NA 

SPA  Fairness  Analyses  White/Black:  Subgroups 

SQTMOSs  31J.  Tesfc  '  SOT  Predlctiort  Cbmposit6?ir- Model:  3 

Sample:  Category  IIIB4IV:  Soldiers:. . 


Standardized  Wntten  SOT  Score. 


V«VVW>^N  VS  VSS  V  ^  V 


Group 

N 

T“st 

MN 

Test 

SD 

Criterion 

MN 

Criterion 

SD 

Slope 

Intercept  R-Square 

R 

Total 

198 

90.935 

8.436 

91.184 

19.236 

0.985 

1.635 

0.187 

0.432 

White 

66 

92.886 

8,500 

93.263 

22.780 

1.146 

-13.217 

0.183 

0.428 

Black 

132 

89.959 

8.264 

90.145 

17.195 

0.897 

9.493 

0.186 

0.431 

Effect  Stze 

P  vakie 

’.V-*AVSSW<WSSV>SW‘- 

0.347 

0162 

■::o:A2&(y 

0.9273 

Predictor  Score  Predicted  Performance  Score  Standard  Error  W>B  Score  Difference 


White 

Black 

White 

Black 

Value 

Undar/Ovar 

73.431 

NA 

75.361 

NA  ■ 

3.019 

NA 

NA 

75.888 

73.748 

77.563 

5.667 

2667 

-3.814 

Under 

81.695 

80.405 

82773 

4.190 

1.910 

-2368 

Under 

84  386 

83.483 

85.187  ' 

3.584 

1.629 

-1  69B 

Under 

90.935 

'  90.^' 

91.062 

2600. 

1  360 

-0.067 

Under 

98.223 

99.347 

97.599 

2993 

,1910 

1  748 

Over-' 

101.386 

102971 

100.436 

3.584 

2304 

2535 

Over 

106.487 

108.817 

105.012 

4.782 

3.019 

3.805 

Over 

109.886 

112712 

NA 

5.667 

NA 

NA 

NA 

B-15 


SP^  Palmess  Analyses  White/BIabk  Subgroups 

SQTMOSs  36C  Test:  SQTsPrediction  Composite  —  Model  3 

Sampler;;  Cate^ryillBSIV  Soldiers- 

Standardized  WnttenSQTScore-^^  ^ 


Test 

Test 

Criterion  Criterion 

Group 

N 

MN 

SO 

MN  SO 

Slope 

Intercept  R-Square  R 

Total 

1742 

100.517 

2957 

100.528  19.353 

0.948 

5.432 

0.021  0.145 

White 

483 

102.324 

2960 

103.979  17.394 

0.865 

15.425 

0.022  0.148 

Black 

1259 

99.823 

2647 

99.204  19.483 

0.746 

24.729 

0.010  0.100 

Effect  Size 

0.B4B' 

0.247 

P^akte 

Predictor  Score 

Predicted 

Performance  Score  Standard  Error 

W-8  Score  OIITerence 

White 

Black 

White 

Black 

Value 

Undar/Ovar 

94.529 

NA 

95.248 

NA 

1.222 

NA 

NA 

96.404 

98.814 

96.646 

1.750 

0.892 

2.168 

Over 

97.176 

99.482 

97.222 

1.570 

0.773 

2.260 

Over 

'  09-364!™'' 

liilliP 

10t*37S 

98.8% 

1.107 

0.654"' 

2:527 

Over" 

„tOD.617 

r:::.1Q2372:::: 

99.715 

0917 

Q.5B5., 

2.658 

Over^ 

t02:470~'"' 

iiiiii 

„  ,104.062:" 

lOt.ITT 

,  _ 0784 

0,773 

2890 

Over- 

105.117 

106.351 

103.146 

1.076 

1.222 

3.205 

Over 

105.284 

106.496 

NA 

1.107 

NA 

NA 

NA 

108.244 

109.056 

NA 

1.750 

NA 

NA 

NA 

SPA  Fairness  Analyses 
SaTMOS=  43E 


Test: 

Samplerr 


White/BIack  Subgroups 

SQT  PiBdiction  Composite  —  Model  3 

Category'  tllB  &  IV  Soldiers' 


Standardized  Written  SCnrscore 

N  S<^S 

Test 

Test 

Crtterlon 

Criterion 

Group 

N 

MN 

SO 

MN 

SO 

Slope 

Intercept  R.Square 

R 

Total 

263 

92878 

5.011 

93.182 

18.257 

0.967 

3.385 

0.070 

0.265 

White 

180 

93.608 

4.964 

94.009 

18.211 

1.160 

-14.575 

0.100 

0.316 

Black 

83 

91.296 

4.768 

91.388 

18.336 

0.482 

47.347 

0.016 

0.126 

Effect  Size 

0.461 

ai44''= 

P  vahja 

-  ~  ' 

_  - -  -  _  U-v... - 

- - ^ 

-  - - 

„„  P.t655;;  Q.6%9 

ililiiiiit; 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Valua 

Undar/Ovar 

81.760 

NA 

86.755 

• 

NA 

4.464 

NA 

NA 

83.680 

82494 

87.681 

2879 

3.762 

-5.187 

Under 

86.528 

85.797 

89.053 

2243 

2823 

-3.256 

Under 

88.644='^ 

88:252" 

90.073  , 

-1.821  - 

2.285. 

-1.821' 

Under-'' 

9287S 

93.163 

92114 

t.302r 

2103 

1.049 

Over  ' 

96.064  - 

iiiiii 

„96.e59" 

93.650  . 

.1.437 

2823 

3.209"  ' 

Over  - 

98.572 

99.769 

94.859 

1.821 

3.643 

4.910 

Over 

100.832 

102390 

95.948 

2274 

4.464 

6.442 

Over 

103.538 

105.527 

NA 

2879 

NA 

NA 

NA 

SPA  Fairness  Analyses 
SQ1:M0S=  52D 


White/BIack  Subgroups: 

Test:  SOT  Prediction  Composite  -  Model  3 

Sampie:  Category  inB&  IV  Soldiers 


•.•.•.•.V.VSVSWfe<'}«V.rAV'.N<Vi*iS^'>i«<pK'  .fWNSS  %%%,».•■«>  %AW-.S  ••, 

standardized  Wntten  SQTScore 

V«S.W>X-»X<W-XC<'Kvrft'i<rtVJ'^tOk!ii4>!*V‘iVV 
\\  -^yy  y 

Test 

Test 

Criterion  Criterion 

Group 

N 

MN 

SO 

MN  SD 

Slope 

Intercept  R-Square 

R 

Total 

223 

97.199 

5.112 

97.004  18.873 

0.997 

0.111 

0.073 

0.270 

White 

170 

97.845 

5.197 

97.203  19.152 

1.087 

-9.158 

0.087 

0.295 

Black 

53 

95.129 

4.249 

96.368  18.109 

0.777 

22465 

0.033 

0.182 

EfTeaSae  0531 

0044-':'-, ' 

Predictor  Score 

Predicted 

Performance  Score  Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

vaiua 

UndairOvar 

86.631 

NA 

SQ.7T7 

NA 

5.470 

NA 

NA 

87.451 

85.901 

90.414 

3.138 

5.052 

-4.513 

Under 

90.880 

89.629 

93.079 

2347 

3.459 

-3.450 

Under 

0Z.64S 

9r.65Q 

94.452 

1.985 

2833 

-2902 

Under 

97483- 

'''y 

"y"'S-'^'^y 

96L487 

97.983.. 

t.4t4 

2721 

-1.491 

Under 

99.378" 

98.866- 

99.682--- 

1,463 

3459.- 

-0816 

Under. 

103.042 

102.849 

10Z529 

1.985 

5.171 

0.320 

Over 

103.627 

103.485 

102.983 

2100 

5.470 

0.501 

Over 

108.239 

108.498 

NA 

3.138 

NA 

NA 

NA 

SPA  Fairness,  Analyses 
SQTMOSs,  64C' 


White/BIack  Subgroups 

Test::  SOT  Prediction  Composite  -  Model  3: 

Sampler'  Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQT  Score-. 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slop* 

Intercept  R-Square 

R 

Total 

5419 

96.926 

6.852 

96.994 

17.256 

1.001 

-0.074 

0.158 

0.397 

White 

2931 

100.419 

6.172 

100.817 

16.925 

0.876 

12821 

0.102 

0.319 

Black 

2488 

92811 

5.106 

92489 

16.543 

1.105 

-10.048 

0.116 

0.341 

Effect  Size 

1110 

^0.4^", 

Pvah/e 

,  - 

0.0035 

'0XM82, 

Predictor  Score 

Predicted  Pertormance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Valua 

Undar/Ovar 

82599 

NA 

81.224 

NA 

0.697 

NA 

NA 

87.705 

NA 

86.866 

NA 

0.441 

NA 

NA 

88.075 

89.975 

87.275 

0.662 

0.425 

2.700 

Over 

94.247 

Kiiii 

95.381 

94095 

0.419 

0.324- 

1.286 

Over 

96.926 

97i728 

97.055" ' 

0  340 

D.400 

0.673-  • 

Over 

•fffJBir 

93596 

98.150 

0320 

0.441 

0446 

Over 

103.023 

103.069 

103.792 

0.322 

0.697 

-0.723 

Under 

106.591 

106.195 

NA 

0.419 

NA 

NA 

NA 

112763 

111.601 

NA 

0.662 

NA 

NA 

NA 

ao  «S  90  99  too  109  110  1H 


B-17 


SPA  Fairness  Analyses  White/BIack  Subgroups 

SQT  MOS  =  71L  Test:  SQT  Prediction  Composite  -  Model  3 

Sample:  CateflorylllBSIV  Soldiers 


Standardized  Written  SQT  Score  - 

ilBiii 

1^11 

Test  Test 

Criterion 

Criterion 

Group 

N 

MN  SO 

MN 

SD 

Slope 

Intercept  R-Square  R 

Total 

1170 

93.348  4.621 

93.137 

17.958 

0.945 

4.926 

0.059  0.243 

White 

342 

95.261  4.659 

96.025 

18.665 

1.277 

-25.624 

0.102  0.319 

Black 

828 

92558  4.370 

91.944 

17.531 

0.728 

24.737 

0.033  0.182 

ER^S/ze 

0585  ' 

i-:'" 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White  Black 

White 

Black 

ValiM 

UndarlOvar 

83.818 

NA  85.589 

NA 

1.340 

NA 

NA 

85.943 

84.125  87.132 

2139 

1.087 

-3.006 

Under 

88.188 

86.992  88.761 

1.739 

0.847 

-1.769 

Under 

90.602'  '  ' 

'90.075.'  90.514'“' 

1.353 

0.656 

-0.439- 

t/ndep^ 

93L34S;".  '' 

^^3.5at''■  92508,2''' 

t034 

0.609 

1.Q74-'-' 

Qvecf',' 

;9&928'':;= 

/98;1532;^  9S.1Q7:,r  , 

PiSBPi 

t.0t6~v 

0.847' 

3.049 

Oven*<."- 

99.920 

101.974  97.279 

1.353 

1.174 

4.695 

Over 

101.298 

103.734  98.279 

1.565 

1.340 

5.454 

Over 

104.579 

107.923  NA 

2139 

NA 

NA 

NA 

rv>.i 


SPA  Fairness  Analyses^’  ^  Whfte/BIack  Subgroups. 

SQTMOSs  82Cr;'  Test:-  SQ^Fredicdon  Composite  -  Model  3' 

sample:."  Category^iUBS^IVSoldlete  ' 


Standardized  Written  SOT  Scores,  ^ 


Test 

Test 

Crtterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

781 

96.920 

6.167 

96.769 

17.118 

0.993 

0.517 

0.128 

0.358 

White 

510 

98.360 

5.997 

99.206 

16.899 

0.926 

8.097 

0.108 

0.329 

Black 

271 

94.210 

5.549 

92183 

16.607 

0.884 

8,915 

0.087 

0.295 

Effect  Size 

iilitix-iilili 

0873 

0  410 

Pvahe 

SSiSSSSSSis! 

fSiSiiiSiii&SAK:: 

- 

ff.»%{vwv»sw4wsv.n»\-.v 

_ 

,0.8406  00107 

Predictor  Score 

Predicted  Performance  Score 

Standard 

Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

vaiua 

Undar/Ovar 

83.112 

NA 

82388 

NA 

2155 

NA 

NA 

86.366 

88.072 

85.263 

1.580 

1.669 

2.809 

Over 

88.661 

90.197 

87.291 

1.344 

1.363 

2906 

Over 

92363 

93.625. 

90.564 

0999 

fiHO'""' 

3.0Q1 

Ovw„ 

9B.920 

97.845-' 

94.^'  ' 

a727r;.' 

'1.073  . 

3253- 

Qvec" 

99759 

,100.474- 

97.102-,,. 

_ _  _ 

0.72S' 

,1,363-,  . 

3,372%,„. 

Ovepss  ;  , 

104.357 

104.732 

101.167 

0.999 

2009 

3.565 

Over 

105.308 

105.612 

102007 

1.082 

2155 

3.605 

Over 

110.354 

110.285 

NA 

1.580 

NA 

NA 

NA 

80  $9  00  ftS  100  10S  110  11$ 


B-18 


SPA  Fairness  Analyses 
SQT1V10S=  92B 


Test: 

Sampler 


White/BlackiSubgrpups 

SQT  PredictiontiCom  posite  ~  Model;  3 

Category  IIIBX  iyiSoIdiers;:; ; 


Standardized  VMtteirSQT  Scores 


Group 

Total 

White 

Black 


N 

115 

55 

60 


Test 

MN 

95.783 

98.241 

93.531 


>'>A'  ,^/Sf,' 


Test 

SO 

8.534 

8.215 

8.257 


Criterion 

MN 

94.882 

100.519 

89.715 


Criterion 

SO 

20.709 

24.002 

15.639 


Slope 

0.893 

1.156 

0.433 


Intercept 

9.350 

-13.072 

49.240 


R-Square 

0.135 

0.157 

O.C^ 


R 

0.387 

0.396 

0.228 


Predictor  Score 

Predicted  Pertbnnance  Score 

Standard  Error 

W-B  Score  Difference 

Whit* 

Black 

Whit* 

Black 

vaiu* 

UndariOvar 

77.017 

NA 

82.588 

NA 

4.396 

NA 

NA 

81.811 

81.502 

84.664 

6.645 

3.413 

-3.163 

Under 

85.274 

85.505 

86.164 

5.552 

Z780 

-0.659 

Under 

90.023 

90.9^ 

682Zt 

420Z 

2.13S! 

2J77 

Oyees-" 

95.783. 

97.653'. 

91714.' 

aiQ2„  * 

2038." 

6939'^' 

''OveR-?=r ' 

101,788  .  - 

,104695'.  93.3U_. 

3.237 

•2780“- 

11.281 

106.456 

109.991 

95.335 

4.202 

3.651 

14.656 

Over 

110.045 

114.140 

96.889 

5.202 

4.396 

17.251 

Over 

114.671 

119.488 

NA 

6.645 

NA 

NA 

NA 

SPA  Fairness  Analyses!:?-  White/Bfa^Subgroups' 

SQTMOS»*94B  Test;'  SQT  Predictiort  Composite  —  Model  3 

Sampler  Category  <116  it  IV  Soldiers 


Standardized  WifttemSCTTSc 

MilMi 

Test 

Vest 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-8quare 

R 

Total 

3091 

97.448 

6.572 

97.458 

18.323 

0.991 

0.932 

0.126 

0.355 

White 

1126 

101.735 

6.478 

102070 

17.498 

0.892 

11.294 

0.109 

0.330 

Black 

1965 

94.991 

5.228 

94.816 

18.266 

1.025 

-2.586 

0.086 

0.293 

Effect  S)za 

1.D2B 

0396 

Pvakia 

•.V  '  S  V  % 

,02.182 

CX3Q30 

-.i; 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

WhM* 

Black 

Whita 

Black 

Valua 

Undar/Ovar 

84.535 

NA 

84.062 

NA 

0.881 

NA 

NA 

88.779 

90.485 

88.412 

1.101 

0.612 

2072 

Over 

89.763 

91.363 

89.421 

1.034 

0.557 

1.942 

Over 

95.257 

96.263.;  95J052- 

0.696'  ' 

0.394- 

1.211; 

Overr 

97.448 

98.218' 

97.2^;  ' 

0.590 '  " 

0.435  ' 

D.919 . 

Over- 

100219 

,  .  ,  J00.689 

101138 

0.506';  , 

0.557, 

0.651 

Ova" 

105.447 

105.353 

105.497 

0.567 

0.881 

-0.144 

Under 

108.213 

107.820 

NA 

0.696 

NA 

NA 

NA 

114.691 

113.598 

NA 

1.101 

NA 

NA 

NA 

ao  «5  90  95  100  109  110  119 


B-19 


SPA  Fairness  Analyses 

SQTMOSs  95B 


Whfte/Bfack  Subgroups 

Test:  SQT  Prediction  Composite  —  Model  3 

Sanqiie:  Category  1116  S  iV  Soldiers 


Standardized  Wntten'SCLTScore 


Test 

MN 

94.868 

96.272 

90.642 


Group  N 

Total  3469 

White  2604 

Bteck  865 


Test 

SD 

5.379 

4.860 

4.602 


Criterion  Criterion 

MN  SD  Slope 

94.855  18.100  1.017 

96.272  18.044  1.046 

90.588  17.602  0.927 


Intercept  R-Square  R 

-1.628  0.091  0.302 

-4.448  0.079  0.281 

6.548  0.059  0.243 


4-%%v'  >5V>  V>»  >^>^5 


Predictor  Score  Predicted  Performance  Score  Standard  Error  W-B  Score  Olfferenca 


White 

Black 

White 

Value 

UndarlOvar 

81.438 

NA 

8Z041 

NA 

1.298 

NA 

NA 

86.040 

NA 

86.307 

NA 

0.821 

NA 

NA 

86.552 

86.085 

86.782 

0.759 

0.777 

-0.696 

Under 

91.412 

'  ''  '  91.169  ; 

'  91'.:^";'' ' ' 

0.480 

0589 

-0.118  . 

Under 

94.868 

,  '  ''  94-784''" 

94.4812.-. 

0353.  . 

a7B8 

Q.^-' 

Over. 

9SL244 

'  ,  .  .  '™195.177'X 

,,^94^39:^;'.  , 

0347 

o.82r 

0.336' 

Over- 

99.846 

99.991 

99.105 

0.421 

1.298 

0.886- 

Over 

101.132 

101.336 

NA 

0.480 

NA 

NA 

NA 

105.992 

106.420 

NA 

0.759 

NA 

NA 

NA 

!vS5 


B-20 


SPA  FAIRNESS  ANALYSES 


CATEGORY  IV  SOLDIERS 


Reduced  Model 


SPA  Fairness  Analyses  White/Black  Subgroups 

Across  All  SQT  MOS  Test:  SQT  Prediction  Composite  —  Reduced  Model 

Sample:  Category  IV  Soldiers 


Standardized  Writtenti;S||i|:  Score 


Group 

Total 

White 

Black 

BfectiSize 

N 

32427 

14830 

17597 

Test 

MN 

97.388 

99.073 

95.969 

0.791 

Test 

SO 

3.926 

3.914 

3.329 

Criterion 

MN 

97.262 

99.559 

95.326 

Criterion 

SO 

17.990 

17.624 

18.068 

Slope 

0.996 

0.840 

1.032 

Intercept  R-Square  R 

0.258  0.047  0.217 

16.383  0.035  0.187 

*3.728  0.036  0.190 

Pyahia 

00004  0.0001 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference" 

Whit* 

Black 

Whtta 

Black 

Valu* 

Undar/Over 

89.311 

NA 

88.441 

NA 

0.299 

NA 

NA 

91.245 

93.029 

90.437 

0.318 

0.232 

2.592 

Over 

92.640 

94.201 

91.876 

0.274 

0.189 

2.324 

Over 

95.159: 

96.317 

94.476: 

0.201 

0.138  r 

Over  ;  : 

97.38S 

98.189 

96.776 

0.155 

Q;145:..: 

:  1:.41-3'.. 

O^er-:-;:, 

9^298:: 

99.793 

98.748 

0.142  ..  . 

0;189;;;; 

;  1.046.'. 

Over- ; 

102.627 

102.590 

102.183 

0.192 

0.299 

0.407 

Over 

102.987 

102.892 

NA 

0.201 

NA 

NA 

NA 

106.901 

106.180 

NA 

0.318 

NA 

NA 

NA 

as - - 

3S  90  95  too  t05  110 


Preociof  Score 


B-23 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  11B  Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample:  Category  IV  Soldiers 


Standardized  Written  SQT  Score 


Test 

test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

12441 

95.901 

4.291 

98.814 

17.501 

1.054 

-2.227 

0.067 

0.259 

White 

6632 

97.261 

4,334 

101.204 

16,934 

0.905 

13.159 

0.054 

0.232 

Black 

5809 

94.348 

3.669 

96.086 

17.740 

1.054 

-3.313 

0.047 

0.217 

Effect  Sfze  - 
Pvekia 

0.679 ; 

00541 

0-0001 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

Whit* 

Black 

Valu* 

Under/Over 

87,010 

NA 

88.396 

NA 

0.508 

NA 

NA 

88.593 

93.336 

90.064 

0.452 

0.423 

3.272 

Over 

90.679 

95.223 

92.263 

0.368 

0.321 

2.961 

Over 

;  92.927 

97.258 

94.632 

0JZ86  " 

b;244::^ 

2.628 

Over; :  : 

95:90t 

99.949 

97.767 

0;212 

0.247 

2.183 

Over- 

98.017 

I0t:864 

99.997 

0.205  :: 

0:321; 

1.867':  :: 

Over:  - 

101.595 

105.102 

103.768 

0.286 

0.503 

1.334 

Over 

101.686 

105.185 

103  864 

0.289 

0.508 

1  321 

Over 

105.929 

109.025 

NA 

0.452 

NA 

NA 

NA 

55  - - 

&S  00  35  100  *  05  110 

Preocsor  Score 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  12C  Test:  SQT  Prediction  Composite  —  Reduced  Model 

Sample:  Category  IV  Soldiers 


Standardized:  Written  SQT  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

454 

97,479 

3  528 

97  067 

16,423 

0.989 

0.644 

0,045 

0.212 

White 

337 

98.324 

3.300 

98  374 

15.905 

0.759 

23.778 

0025 

0.158 

Black 

117 

95.044 

3,001 

93  301 

17  356 

1  298 

-30,049 

0  050 

0.224 

Effect  Size 

0.930 

0-3391 

"  0.2459 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

89.042 

NA 

85.528 

NA 

3.497 

NA 

NA 

91 .724 

93.397 

89.009 

1.913 

2.332 

4.388 

Over 

92.043 

93.639 

89.423 

1.839 

2.212 

4.216 

Over 

95.024 

95.901 

93.292 

1.210; 

1:564: 

2609  : ; 

Over 

97.479 

97.765 

96.479 

0.883 

2.014 

1:286 

Over  : 

.  98. 045 ^ 

9ai94 

97.213 

0,859 

2.212 

0.981  : 

Over 

101.046 

100.472 

101.109 

1  109 

3.497 

-0.637 

Under 

101  624 

100.911 

NA 

1  210 

NA 

NA 

NA 

104.924 

103.415 

NA 

1  913 

NA 

NA 

NA 

105 


S8  90  92  94  S6  96  100  *03  t04  106 

Preoaof  Score 


B-24 


SPA  Fairness  Analyses 
SQT  MOS  =  13B 


White/Black  Subgroups 

Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample:  Category  IV  Soldiers 


■StandaPyi^pVVn^rtiSQ^^ 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SO 

Slope 

intercept  R-Square  R 

Total 

7567 

98.516 

2.967 

98.399 

18.273 

0.977 

2187 

0.025  0.158 

White 

2781 

99.952 

3.019 

99.781 

18.350 

■  0.938 

6.003 

0.024  0.155 

Black 

4786 

97.681 

2.593 

97.596 

18.182 

1.011 

-1.161 

0.021  0.145 

Effect  Stze.  ■■■: 

0  765 

Pvaiaa 

06311 

06333 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

92.495 

NA 

92.351 

NA 

0.581 

NA 

NA 

93.914 

94.094 

93.786 

0.769 

0.459 

0.308 

Over 

95.088 

95.196 

94.973 

0.652 

0.368 

0.223 

Over 

96:9S3 

96.926^ 

96.838 

0.486  \ 

0;271 

0.088 

Over 

9a5t6 

98.411 

98.439 

0.381 

0.273 

-0.028 

Under 

.  :;10Q;274  :: 

100-060.: 

ia);21:6::  : 

0.346 

0.368 

-0.166 

Under 

102.867 

102.492 

102.838 

0.478 

0.581 

-0.345 

Under 

102.971 

102.590 

NA 

0.486 

NA 

NA 

NA 

105.990 

105.422 

NA 

0.769 

NA 

NA 

NA 

106  - - 

104  e . 

... 

5  102  ! 

100  I . 

. JT- 

_ 

i  M . 

. 1 

o 

■ 

£  “ : . 

. 

. .aiecx  1 

94  .  .  a- 

92  - 

92  94 

96  96  100 

102  104  106 

PreOdor  Score 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  15E  Test:  SQT  Prediction  Composite  ~  Reduced  Model 

Sample:  Category  IV  Soldiers 

S;^ndardizedj  Written  SQT  Score 


Test 

Test 

Critenon 

Critenon 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

201 

88.720 

8  200 

88.578 

17.577 

0966 

2,866 

0.203 

0.451 

White 

113 

92.555 

7  224 

93.967 

16  923 

0,576 

40,634 

0,060 

0.245 

Black 

88 

83.796 

6617 

81.658 

15.979 

1.127 

-12.741 

0.218 

0.467 

Effect  Size 

1.068 

felVs/WBs::-;  ■ 

0,0420 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

70.562 

NA 

66.782 

NA 

3.368 

NA 

NA 

77.179 

NA 

74.240 

NA 

2.130 

NA 

NA 

78.107 

85.624 

75.286 

3.451 

1,986 

10.338 

Over 

85.331 

89.785 

83.427 

2183 

1.548  - 

8358;:  = 

Over;--:-  ■  ■ 

88.720 

91.737 

87.248 

1.747 

1,878 

4:490;  ; 

Oiyer: 

90:413 

92712 

89.154 

1:610 

2130;  : 

3:557;--: 

Over; 

97.030 

96.523 

96.612 

1.816 

3.368 

-0.089 

Under 

99.779 

98.107 

NA 

2.183 

NA 

NA 

NA 

107.003 

102.268 

NA 

3.451 

NA 

NA 

NA 

ttO  - 
too  »• 


60  - 
70 


00 


90  100 

Predktor  Score 


110 


■B-25 


SPA  Fairness  Analyses 
SQTMOS=  16R 


White/Black  Subgroups 

Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample:  Category  IV  Soldiers 


Slaiitiardized  Written  SQiT  Score;: 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square  R 

Total 

532 

94.363 

5.232 

94.245 

20.160 

1.005 

-0.561 

0.068  0.261 

White 

254 

96.485 

5.211 

96.995 

19.902 

0.911 

9.094 

0.057  0.239 

Black 

278 

92.424 

4.447 

91.731 

20.101 

1.006 

-1.209 

0.049  0.221 

Effect  Size  : 
PvahB 

0:776 

a7891 

a4477 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference' 

White 

Black 

White 

Black 

Value 

Under/Over 

83.530 

NA 

82.822 

NA 

2.629 

NA 

NA 

86.063 

87.497 

85.370 

2.712 

2.052 

2.127 

Over 

87.977 

89.241 

87  296 

2.322 

1.663 

1.945 

Over 

91.274 

92.245 

90.613 

1.715 

1:214- 

1;K32 

Over 

94.363 

95.059 

93.720 

1.309 

1:283: 

1.339 

Over: 

96.871: 

97.343 

96.243 

1.216 

1.663: 

1:10a 

Over 

101.318 

101.395 

100.717 

1  654 

2.629 

0.678 

Over 

101.696 

101.739 

NA 

1.715 

NA 

NA 

NA 

106.907 

106.486 

NA 

2.712 

NA 

NA 

NA 

105  • 

S  *3 

S  90  f 
X 

as  t 


.-jr.. 


■ 


60  i- 
80 


X3  95  too 
Pre<Ki<y  Score 


SPA  Fairness  Analyses 
SQT  MOS  =  36C  Test: 

Sample; 


White/Black  Subgroups 

SQT  Prediction  Composite  -  Reduced  Model 

Category  IV  Soldiers 


S^ndard  ized;  Written :  SQT  S  core^ ; 


Test 

Test 

Criterion 

Crltenon 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

1356 

99,761 

2.170 

99  786 

19.606 

0  968 

3.199 

0.011 

0.105 

White 

312 

100.824 

2  318 

102.737 

17  935 

1,050 

-3.145 

0,018 

0.134 

Black 

1044 

99.443 

2.020 

98.904 

20,002 

0.741 

25.184 

0.006 

0.077 

Effect  Size 

0.636 

PyatU&::>:r:. 

.:;:;:a5830. 

.::  :d0395: 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

95.403 

NA 

95  878 

NA 

1.380 

NA 

NA 

96.188 

97  852 

96.459 

2.250 

1.170 

1.393 

Over 

97.423 

99.149 

97  374 

1.787 

0.873 

1.775 

Over 

98.506 

100.286 

98.177 

1.423 

0:680 

2.109  :; :: 

Over- 

99.761 

101.604 

99.107 

1.107 

0.625 

2.497!  - 

Over- 

101.463 

103.391 

100.368 

1:044 

0:873 

.3:023:::' 

Over 

103.142 

105.154 

101.612 

1.423 

1.288 

3.542 

Over 

103.483 

105.512 

101.865 

1.531 

1,380 

3.647 

Over 

105.460 

107.588 

NA 

2.250 

NA 

NA 

NA 

108  - 

106  i 
g  104  - 

r  -02  - 

1  too  . 

o 

I  98  - 

96  - 

94  - 

94 


98  100  107  104  106 

Pre<>ctor  Score 


96 


B-26 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQTMOS  =43E  Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample;  Category  IV  Soldiers 


R 

0.210 

0.253 

0.122 


Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Dlfferenc 

White 

Stack 

Whit* 

Black 

Value 

Undar/Ovar 

82.671 

NA 

85.959 

NA 

5.103 

NA 

NA 

83.723 

83.436 

86.601 

3.857 

4.558 

-3.165 

Under 

86.555 

86.441 

88.329 

2.896 

3.227 

-1.888 

Under 

88.074;: 

'^aaosa- 

89:255 

Z439 

Z672 

; -1:203- 

;  Under 

"  91.637; 

91.833 

9i;429 

1;i753 

2:388; 

.0:404:  ■  : 

94.323 

:  94683.. 

93.067 

1;;882 

21227 

96.776 

97.285 

94.563 

2.439 

4.367 

2.722 

Over 

98.207 

98.804 

95.436 

2.869 

5.103 

3.367 

Over 

101.127 

101.902 

NA 

3.857 

NA 

NA 

NA 

Standardized  Written  SQT  Score 


Test 

Test 

Group 

N 

MN 

SD 

Total 

174 

91.637 

4.273 

White 

105 

92.425 

4.351 

Black 

69 

90.439 

3.884 

EtfaotiSfze 

0.465 

Pvahf0.  - 

Criterion  Criterion 


MN 

SO 

Slope 

Intercept  R-Square 

91.902 

18.574 

0.912 

8.301 

0.044 

92.701 

18.268 

1.061 

-5.394 

0.064 

90.686 

19.099 

0.610 

35.530 

0.015 

03225 

0941® 

60  . . .  ■  . . 

ao  es  90  93  100  los 

P>r«<»dof  Score 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  64C  Test:  SQT  Prediction  Composite  —  Reduced  Model 

Sample;  Category  IV  Soldiers 

Standardized  WritfepSQT  Score; 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

4089 

94.851 

5.677 

94.925 

16.966 

1,001 

-0.007 

0.112 

0.335 

White 

1920 

97.873 

5.141 

98.431 

16.929 

0.874 

12.899 

0.070 

0.265 

Black 

2169 

92.177 

4.706 

91.822 

16.389 

1.025 

-2.673 

0.087 

0.295 

Effect  Size 

1.003 

P  Vsit/e::;:-  :  : 

0.036:1 

Predictor  Score 

■ 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

Whit« 

Black 

Whit* 

Black 

Value 

Und*r/Ov*r 

82.765 

NA 

82.161 

NA 

0.752 

NA 

NA 

87.471 

NA 

86.985 

NA 

0.476 

NA 

NA 

87.591 

89.454 

87.108 

0.833 

0.470 

2.346 

Over 

92T32: 

93:947- 

92:377 

01527;:- 

0:339' 

1.569 

Over 

94.851; 

95:759- 

94.549 

1". 

0:432::; 

0:387 

1.249 

Over 

96.883- 

:  97:.575::- 

96:632 

0:379- ; 

;0;476 

0.943 

Over 

101.589 

101  688 

101.456 

0.460 

0.752 

0.232 

Over 

103.014 

102.933 

NA 

0.527 

NA 

NA 

NA 

108.155 

107.426 

NA 

0.833 

NA 

NA 

NA 

65  •  •  • 


■ 

eo  ^ - - - - - 

ao  as  90  95  too  105  110  B-27 

PredCtor  Score 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  71L  Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample:  Category  IV  Soldiers 

Standardized 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square  R 

Total 

626 

91.902 

3.450 

91.532 

17.252 

0.978 

1.692 

0.038  0.195 

White 

137 

92.718 

3.787 

91 .963 

18.303 

0.844 

13.708 

0.030  0.173 

Black 

489 

91.673 

3.318 

91.411 

16.963 

1.036 

.-3.546 

0.041  0.202 

Effect  Size- 

0.303 

Pvehie 

a7720 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference. 

Whit* 

Black 

Whita 

Black 

Value 

Under/Over 

85.037 

NA 

84.552 

NA 

1.680 

NA 

NA 

85.144 

85.570 

84.663 

3.444 

1.658 

0.906 

Over 

88.355 

88.280 

87.990 

2.350 

1.062 

0.290 

Over 

88.93T  i 

88.766 

88.587 

2178 

0.975 

0.179 

Over- 

91.902":  ; 

91.273 

91.664 

1:575 

0.753:  "■ 

-0.391 

Under  ;  : 

94.991  : 

93.880  ^ 

94.865 

1.796; 

1.062.:; 

-0.984 

Under 

96.505 

95.158 

96.433 

2.178 

1.327 

-1.275 

Under 

98.309 

96.681 

98.302 

2.746 

1  680 

-1.621 

Under 

100.292 

98  354 

NA 

3.444 

NA 

NA 

NA 

sa  » . - - 


94  06  M  90  92  94  96  90  too  102 

Pr«CKior  Scot* 

SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  82C  Test:  SQT  Prediction  Composite  —  Reduced  Model 

Sample:  Category  tV  Soldiers 

Stehdardized  Written  SQiT  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

447 

94  612 

4  469 

94  504 

17  059 

1  041 

-4.027 

0.074 

0.272 

White 

250 

95,928 

4  264 

97.250 

17.021 

0  993 

2.024 

0.062 

0.249 

Black 

197 

92.942 

4.164 

91  020 

16  502 

0,804 

16.263 

0.041 

0.202 

Effect  Size 

0.668 

P'Ualue- 

0l6127 

.:  0.0344 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

Whiu 

Black 

Whit« 

Black 

Value 

Undar/Ovar 

84.614 

NA 

84.293 

NA 

2.575 

NA 

NA 

87.400 

88,812 

86.533 

2.331 

1  917 

2.280 

Over 

88.778 

90.181 

87.641 

2.036 

1,628 

2.540 

Over 

■  i ;  91  664 

93.046-: 

89.961  : 

t:474 

1.204 

3.085 

Over-:;;- 

94.812 

95:974:; 

92331 

1:091 

1.241 

3,643 

Over; ! 

97.106; 

98:450:; 

94.336; 

1.082;; 

1.628.. 

4:1:14 

Over  : 

100.192 

101.515 

96.817 

1.474 

2.312 

4.697 

Over 

101.270 

102.585 

97.684 

1  671 

2.575 

4.901 

Over 

104.456 

105.749. 

NA 

2.331 

NA 

NA 

NA 

SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  94B  Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample:  Category  IV  Soldiers 


i^ndard  feed:  Written :  SQpS  core: 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square  R 

Total 

2531 

96.123 

5.956 

96.199 

18.262 

0.996 

0.465 

0.105  0.324 

White 

781 

99.802 

5.779 

100.851 

17.414 

1.054 

-4.352 

0.122  0.349 

Black 

1750 

94.481 

5.261 

94.123 

18.254 

0.880 

10.995 

0.064  0.253 

Effect  Size. 

0  893 

Pvsiae 

04^ 

a<»48 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

83.959 

NA 

84  879 

NA 

0.944 

NA 

NA 

88.244 

88.657 

88.650 

1.306 

0.655 

0.007 

Over 

89.220 

89.686 

89.509 

1.218 

0.597 

0.177 

Over 

94:023;: 

94:748^ 

93.735 

0:826 

■0;424;5"::;- 

tiOia:.*:; : : 

Ovw- 

96.123 

96.962 

95.583 

0;B92 

0:442:; 

T;37&: 

Over 

99.742 

100.776: 

98.768 

0:584 

0:597:  : 

2:008 

Over  ; 

105.003 

106.321 

103.398 

0.786 

0.944 

2.924 

Over 

105.581 

106.930 

NA 

0.826 

NA 

NA 

NA 

111.360 

113.021 

NA 

1.306 

NA 

NA 

NA 

115  «•- 
110  * 

3  105 

'■ 

too  t 

5  I 

a.  9S  i-. 
b  « 

I  sol¬ 
as  i- 


80  I 


80 


. 


m 

.i  Sleek 


do  55  100  t05 

Preaeior  Score 


SPA  Fairness  Analyses 
SQT  MOS  =  9SB  Test: 

Sample: 


White/Black  Subgroups 

SQT  Prediction  Composite  -  Reduced  Model 

Category  IV  Soldiers 


Standard  ized:  Written  SQT  Score: 


Test 

Test 

Critenon 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

Total 

1500 

91.709 

3.391 

91.717 

18.132 

1  014 

-1,232 

0.036 

White 

969 

92.672 

3  220 

92.596 

18  430 

1  159 

-14,793 

0,041 

Black 

531 

89  951 

2.964 

90.113 

17.479 

0.755 

22.173 

0,016 

Effect  Size 

0.802 

Pivalue: 

:Q:2ai:5 

0.7566 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Undercover 

84.023 

NA 

85.610 

NA 

1.662 

NA 

NA 

86.232 

85.150 

87.278 

1.296 

1.207 

-2.128 

Under 

86.987 

86.025 

87  848 

1.176 

1.064 

-1.823 

Under 

89:452 

88:882 

89.709  : 

0:820 

0.763 

-0.827 

Under 

91.709 

::91i48a:;:: 

91.413 

Q;B05 

0.875 

0.084 

Over 

92.915  :.; 

.9^8^  :  : 

92.324:  ::. 

0;581 

1  064 

0.572 

Over 

95.879 

96.331 

94.562 

0.818 

1.682 

1.769 

Over 

95.892 

96.346 

NA 

0.820 

NA 

NA 

NA 

99.112 

100.078 

NA 

1.296 

NA 

NA 

NA 

102  f-- 

too 

«  58  1 

8  56 : 

■A 


V 

i 


52  • 
90  • 
38  • 


86  i-- 

64  i - 


64  66  88  90  92  94  96  98  100 

Predictor  Score 


B-29 


SPA  FAIRNESS  ANALYSES 

CATEGORY  IIIB  &  IV  SOLDIERS 
Reduced  Model 


B-31 


SPA  Fairness  Analyses 
SQTMOS  =  11 B  Test: 

Sampler 


White/Black  Subgroups 
S QT  Prediction  Com posite  -^  Reduced  Model 
Category  IIIB  &  IV  Soldiers: 


Standardized  Written  SQT  Score 


Test 

Test 

Ciiteiion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

17635 

100.641 

5.258 

100.486 

17.581 

1.011 

-1.246 

0.108 

0.329 

White 

10322 

102.392 

5.233 

103.101 

16.914 

0.866 

14.431 

0.072 

0.268 

Black 

7313 

98.170 

4.193 

96.794 

17.842 

1.043 

-5.556 

0.060 

0.245 

STectSae 

0.803 

iBi 

Pvah/e 

0.0717 

'0.0001 

Predictor  Score 

Predicted  Performance  Score 

standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

89.784 

NA 

88.089 

NA 

0.452 

NA 

NA 

91.926 

94.039 

90.323 

0.359 

0.363 

3.716 

Over 

93.977 

95.815 

92.462 

0.304 

0.286 

3.353 

Over 

97.159 

98.671 

95781 

0.227 

Q.208 

Z790 

Over' 

100.641 

101  686 

99.413 

0189 

0235 

2.174 

Over 

1(0.363 

103.077 

101.209 

0160 

0  286 

1.869 

Over. 

106.556 

106.708 

105.582 

0.205 

0.452 

1.127 

Over 

107.625 

107.634 

NA 

0.227 

NA 

NA 

NA 

112.858 

112.166 

NA 

0.359 

NA 

NA 

NA 

SPA  Fairness  Analyses 
SQTMOS*  12C  Test: 

Sample: 


White/Biack  Subgroups 

SQT  Prediction  Composite  •-  Reduced  Model 

Category  IIIB  &  tV  Soldiers 


Standardized  Written  SQT  Score 


Group 

N 

Test 

MN 

Total 

645 

97.133 

White 

512 

97.762 

Black 

133 

94.712 

Effect  Size 
Pvak/a 

1.079 

Test 

Criterion 

Criterion 

SD 

MN 

SD 

2.828 

98.462 

16.135 

2.674 

99.628 

15.469 

1.972 

93.973 

17.839 

Slope 

Intercept 

R-Square 

R 

1.129 

-19.996 

0.046 

0.214 

0.886 

13.040 

0.023 

0.152 

2.382 

-131.632 

0.069 

0.263 

a0440 

ateii 

Predictor  Score 

Predicted 

Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

90.768 

NA 

84.577 

NA 

3.337 

NA 

NA 

92.414 

94.919 

88.498 

1.511 

2.292 

6.421 

Over 

92.740 

95.208 

89.275 

1.438 

2.111 

5.933 

Over 

95-088 

^7.288 

94.863 

0-956 

1:519 

2  420 

Over 

97-133 

99.100 

99.739 

0.694 

■  2.363 

-0.839 

Under' 

96.684 

9a702 

98.669 

0.729 

ZIU 

0  033 

Over 

98.656 

100.449 

103.367 

0.712 

3.337 

-2.917 

Under 

100.436 

102.026 

NA 

0.956 

NA 

NA 

NA 

103.110 

104.395 

NA 

1.511 

NA 

NA 

NA 

60  I . t 

90  92  94  96  96  100  102  104 

Precictor  Score 


B-33 


SPA  Fairness  Analyses 
SQTMOS=  13B  Test: 

Sample: 


White/Black  Subgroups 

SQT  Prediction  Composite  —  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQT  Scor& 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SO 

Slope 

Intercept  R-Square 

R 

Total 

9916 

99.341 

3.536 

99.231 

18.165 

0.986 

1.276 

0.037 

0.192 

White 

4052 

101.146 

3.604 

101.138 

18.152 

0.949 

5.158 

0.036 

0.190 

Black 

5864 

98.093 

2891 

97.913 

18.059 

0.994 

0.428 

0.025 

0.158 

Effect  5ae 

0.863' 

P  valaa 

<■'  A 

0.®89^  '  ti.0C3dl'  '  -  ' 

Predictor  Score 

Predicted  Performance  Score 

standard  Error 

W-B  Score  Difference 

Whtt* 

Black 

White 

Black 

Value 

Under/Over 

92.311 

NA 

92.185 

NA 

0.521 

NA 

NA 

93.938 

94.305 

93.802 

0.626 

0.408 

0.503 

Over 

95.202 

95.505 

95.059 

0.540 

0.329 

0.446 

Over 

97.542 

97.725 

97.3K 

0.396 

0.237. 

0.341 

Over  ' 

99.341 

.99.433 

99.173 

03t3 

0254 

6260 

Over 

100.984 

100.992 

100806 

0^ 

0.329' 

o.i8r 

Over 

103.875 

103.735 

103.680 

0.351 

0.521 

0.056 

Over 

104.750 

104.566 

NA 

0.396 

NA 

NA 

NA 

108.354 

107.986 

NA 

0.626 

NA 

NA 

NA 

SPA  Fairness  Analyses 
SQTMOS  -  15E  Test: 

Sample: 


White/Black  Subgroups 

SQT  Prediction  Composite  —  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized.  Written  SQT  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

Tptal 

294 

90.660 

8.280 

90.699 

18.177 

0.981 

1.775 

0.199 

White 

187 

94  049 

7.134 

95.619 

17.249 

0.641 

35.329 

0.070 

Black 

107 

84.749 

6.686 

82.102 

16.551 

1.073 

-8.792 

0.188 

Effect  Sizer 

1.123 

Pvatue 

01328 

90079 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

71.377 

NA 

67.796 

NA 

3.224 

NA 

NA 

78.063 

NA 

74.970 

NA 

2039 

NA 

NA 

79.781 

86.469 

76.813 

2.720 

1.796 

9.656 

Over 

86915 

91.042 

84.'468 

1.720 

1.518 

6.574 

Over 

90.660 

93.442 

88.488 

1  347 

1:924- 

4.^ 

Over 

91.4^ 

93.939 

89318 

1298 

2039 

4.621 

Over 

98.121 

98.225 

96.492 

1.401 

3.224 

1.733 

Over 

101.183 

100.187 

NA 

1.720 

NA 

NA 

NA 

108.317 

104.760 

NA 

2.720 

NA 

NA 

NA 

R 

0.446 

0.265 

0.434 


SPA  Fairness  Analyses 
SQTMOS=  16R  Test: 

Sample: 


White/Black  Subgroups 

SQT  Prediction: Composite:  —  Reduced  Model 

Category  Ills  &  IV  Soldiers 


Standardized  Written  SQT  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

617 

95.828 

6.159 

95.709 

19.679 

0.999 

-0.069  0.098 

0.313 

White 

319 

98.437 

6.214 

99.015 

18.969 

0.902 

10.200  0.087 

0.295 

Black 

298 

93.034 

4.710 

92.171 

19.841 

0.998 

-0.708  0.056 

0.237 

BfectSiza- 

0.877 

P  value 

a736e 

02^ 

Predictor  Score  Predicted  Performance  Score  Standard  Error  W>B  Score  Difference 


White 

Black 

White 

Black 

Valu* 

Undar/Ovar 

83.614 

NA 

82739 

NA 

2497 

NA 

NA 

86.009 

87.780 

85.129 

2.269 

2.005 

2.651 

Over 

88.324 

89.868 

87.439 

1.938 

1.579 

2429 

Over 

92223 

93  385 

91  331 

1.435  • 

1.133 

ZCG5 

Over  ' 

95.828 

96.837 

94.928 

1.101 

1  298 

1  709 

Over 

97,744 

gases 

9a84t 

1  021 

1.579'  , 

1625 

Over  ' 

102.454 

102.614 

101.541 

1.208 

2497 

1.072 

Over 

104.651 

104.595 

NA 

1.435 

NA 

NA 

NA 

110.865 

110.200 

NA 

2.269 

NA 

NA 

NA 

SPA  Fairness  Analyses 
SQTMOS=  31J  Test: 

Sample: 


White/BIack  Subgroups 

SQT  Prediction  Composite  —  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQT  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

198 

90.795 

4.866 

91.184 

19.236 

1.014 

-0.874 

0.066 

0.257 

White 

66 

92.156 

4.637 

93.263 

22.780 

1.305 

-26.985 

0.071 

0.266 

Black 

132 

90.115 

4.852 

90.145 

17.195 

0.852 

13.409 

0.058 

0  241 

Effect  SfZB 

P  value 

0.419 

a463a 

0.7043 

Predictor  Score 

Predicted 

9 

Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

Whita 

Black 

Valua 

Under/Ovar 

80.411 

NA 

81.919 

NA 

3.248 

NA 

NA 

82.882 

81.176 

84.024 

6.043 

2.607 

-2.848 

Under 

85.263 

84.283 

86.053 

4.842 

2.054 

-1.770 

Under 

87.513 

87.227' 

87,975 

3.822 

1.647 

-0.748 

Under 

90.795 

91.502 

90.766 

2  817 

1.467 

0  738 

Over 

94.967 

96.947 

94-321 

3.160 

2.054,' 

2.626 

Over 

96.793 

99.330 

95.877 

3,822 

2.471 

3.453 

Over 

99.819 

103.279 

98.455 

5,220 

3.248 

4.824 

Over 

101.430 

105.381 

NA 

6.043 

NA 

NA 

NA 

110 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  36C  Test:  SQT  Prediction  Composite —  Reduced  Model 

Sample:  Category  lltB  &  IV  Soldiers 

Standardfxed  Written  SQTScore 


Group 

Total 

White 

Black 

EfTact  Size 
PvahJa 

N 

1752 

486 

1266 

Test 

MN 

100.544 

102.022 

99.977 

0.787' 

Test 

SD 

2598 

2752 

2297 

Criterion 

MN 

100.438 

103.883 

99.116 

Criterion 

SD 

19.386 

17.386 
19.950 

Slope  Intercept  R-Square 

0.923  7.618  0.015 

0.785  23.778  0.015 

0.689  30.192  0.006 

OSCfflZ'  'ojxsm: 

R 

0.122 

0.122 

0.077 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  DHTerence 

Whit* 

Black 

Whit* 

Black 

Valu* 

Undar/Ovar 

95.383 

NA 

95.911 

NA 

1.250 

NA 

NA 

96.518 

99.545 

96.693 

1.750 

1.011 

2.852 

Over 

97.680 

100.457 

97.494 

1.462 

0.791 

2963 

Over 

m.270 

101.705^ 

98.589 

1.107 

0.585 

3.116 

Over 

t0a544- 

102  7QS: 

99.467 

a888 

0.578 

3.238' 

Over 

.  102.274 

104  063;; 

;:iq0;659 

0.786 

0.781 

3.404 

Over 

104.571 

105.866 

102241 

1.067 

1.250 

3.625 

Over 

104.774 

106.026 

NA- 

1.107 

NA 

NA 

NA 

107.526 

108.186 

NA 

1.750 

NA 

NA 

NA 

PredKd<9r  Score 


SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  43E  Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample:  Category  1116  &  IV  Soldiers 

Steridardii^d:  Written  SQl^  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

264 

92.876 

4610 

93  106 

18  264 

0.966 

3.404 

0.059 

0.243 

White 

181 

93.569 

4  626 

93  893 

18.227 

1  158 

-14.500 

0  086 

0.293 

Black 

83 

91  365 

4  220 

91  388 

18.336 

0.425 

52.545 

0  010 

0.100 

Effect  Size 

0.478 

Rvalue- 

m: 

;  ■  ;  0:1801 

;;;:  08696: 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

Whit* 

Black 

Whit* 

Black 

Valu* 

Under/Ovar 

82.925 

NA 

87.788 

NA 

4.478 

NA 

NA 

84.317 

83.139 

88.380 

2.896 

3.898 

-5.241 

Under 

87.145 

86.414 

89.582 

2216 

2.832 

-3.168 

Under 

88:943 

;  88:496 : 

90.346 

i;832  ; 

2:309 

-1  850 

Under 

92876 

93:050  : 

92017 

1310 

2127 

1:033 

Over 

95.585 

.96:187 

93.169 

1413 

2832;;::. 

3:019 

Over; 

98.195 

99.210 

94.278 

1.832 

3.810 

4.932 

Over 

99.805 

101.074 

94  962 

2.174 

4.478 

6.112 

Over 

102821 

104.567 

NA 

2.896 

NA 

NA 

NA 

105  . - 

100  • 

5 


90  95  90  95  too  105  B-36 

Pre<9ctor  Score 


SPA  Fairness  Analyses 
SQTMOS=  52D  Test: 

Sample: 


White/Black  Subgroups 

SQT  Prediction  Composite  -  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQT  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SO 

Slope 

Intercept  R-Square  R 

Total 

223 

97.244 

3.509 

97.004 

18.873 

0.999 

-0.154 

0.035  0.187 

White 

170 

97.744 

3.415 

97.203 

19.152 

0.989 

0.540 

0.031  0.176 

Black 

53 

95.643 

3.352 

96.366 

18.109 

1.217 

-20.015 

0.051  0.226 

Effect  Size 

0.599 

Pwkje 

'  aTSST 

Predictor  Score 

Predicted 

Performance  Score 

Standard  Error 

W-B  Score  Difference' 

White 

Black 

White 

Black 

Value 

Under/Over 

88.939 

NA 

88.224 

NA 

5.418 

NA 

NA 

M.914 

90.454 

90.627 

3.233 

4.190 

-0.173 

Under 

92.291 

91.816 

92.303 

2.724 

3.427 

-0.487 

Under 

:  94.323 

93i831Ki-^ 

94783 

Z045"  : 

2603 

-0.9S2 

Under 

97.244 

96:714-  : 

98.331 

1.4S1 

2.685 

-1.817 

Under 

::98;995:-::: 

98J446; 

100:462; 

1  540: 

3.427 

-2016 

Under 

101.159 

100.586 

103.096 

2.045 

4.666 

-2.509 

Under 

102.347 

101.761 

104.541 

2.427 

5.418 

-2.780 

Under 

104.574 

103.964 

NA 

3.233 

NA 

NA 

NA 

85  i—  . 
U  90  92 


a 


I 


94  96  96  100  102  104  106 

PrecKtor  Score 


SPA  Fairness  Analyses 

SQT  MOS  =  64C  Test: 

Sample: 


White/Biack  Subgroups 

SQT  Prediction  Composite  —  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized  Wilkin  SQT  Score 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept 

R-Square 

R 

Total 

5442 

96.894 

6.580 

96.989 

17.262 

1.000 

0.030 

0.145 

0.381 

White 

2942 

100.226 

5  864 

100.827 

16.935 

0.876 

13.017 

0.092 

0.303 

Black 

2500 

92.972 

5.033 

92.471 

16.539 

1.030 

-3.268 

0.098 

0.313 

Effect  Size-  ■ 

1.102 

Pvahia 

0.0573 

aoo25 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

82.906 

NA 

82.125 

NA 

0.702 

NA 

NA 

87.939 

NA 

87.309 

NA 

0.444 

NA 

NA 

88.498 

90.541 

87.885 

0.665 

0.420 

2.656 

Over 

94362-;-;,;  ■■■': 

95.678'- 

93.925- 

0:421 

0:326  v 

;1-;7^3::::-:;:: 

Over 

96.;8B4  ^ 

97.896- 

96.533 

0:342 

0:398 

1.363; :: 

Over 

98:005;;;; 

98;869;:x: 

97;627  - 

0;31;8-  . 

;0:444.-:;::.;.; 

.■1;,:1-92k;:;;-:;: 

..Over:- 

103.038 

103.278 

102.861 

0.330 

0.702 

0.417 

Over 

106.090 

105.952 

NA 

0.421 

NA 

NA 

NA 

1 1 1 .954 

111.089 

NA 

0.665 

NA 

NA 

NA 

115  r 
110  »• 
5  105  }- 

u 

s-  95  ;• 
^  I 
£  90  f- 

89  \- 
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SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  7iL  Test:  SQT  Prediction  Composite  -  Reduced  Model 

Sample:  Category  IIIB  &  IV  Soldiers 


:  i^^ardiziediV^riiHen 


Test 

Test 

Criterion 

Criterion 

Group 

N 

MN 

SO 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

1177 

93.417 

4.146 

93.164 

17.925 

0.912 

7.983 

0.045 

0.212 

White 

343 

95.305 

4.225 

96.043 

18.640 

1.251 

-23.144 

0.080 

0.283 

Black 

834 

92.640 

3.856 

91.980 

17.497 

0.660 

30.876 

0.021 

0.145 

Effect  Size 

0;643. 

clo:^ 

"  ai29f 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

84.928 

NA 

86.928 

NA 

1.340 

NA 

NA 

86.855 

85.512 

88.200 

2.159 

1.081 

-2.689 

Under 

88.784 

87.925 

89.473 

1.775 

0.848 

-1.549 

Under 

91.080 

90J797'-; 

90.989  ;  : 

1.365 

0.647 

-0.192 

Under 

93.417 

93;721:;:  ; 

92.531: :: 

1.D57 

0.612 

1.189 

Over 

96.496 

97:5^:;;: 

94:563:;  :  : 

1:003 

0.848 

3:009 

Ovw 

99.530 

101.368 

96.566 

1.365 

1.227 

4.802 

Over 

100.352 

102.396 

97.108 

1.504 

1.340 

5.288 

Over 

103.755 

106.654 

NA 

2.159 

NA 

NA 

NA 

105 .  .  -  ..-r 
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SPA  Fairness  Analyses  White/Black  Subgroups 

SQT  MOS  =  82C  Test:  SQT  Prediction  Composite  —  Reduced  Model 

Sample:  Category  IIIB  &  IV  Soldiers 

StandardizediWritten  SQT  Score 


Test 

Test 

Criterion 

Crltenon 

Group 

N 

MN 

SD 

MN 

SD 

Slope 

Intercept  R-Square 

R 

Total 

788 

96.857 

5  413 

96.841 

17.098 

0  978 

2.150 

0.096 

0.310 

White 

514 

98.426 

5  075 

99.229 

16.856 

0.867 

13  942 

0.068 

0.261 

Black 

274 

93.915 

4.769 

92.362 

16  672 

0  895 

8.300 

0.066 

0.257 

Effect-Size 

0.833 

;;:;;:0.9090 

0.0277 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

White 

Black 

White 

Black 

Value 

Under/Over 

84.377 

NA 

83.817 

NA 

2.177 

NA 

NA 

88.276 

90.477 

87.307 

1  605 

1.507 

3.170 

Over 

89.146 

91.232 

88.086 

1  496 

1.377 

3.146 

Over 

:  ;;^.351 

94J877 

91.849 

1,015: 

0.980 

3.028 

Over 

96  857 

.  97:917 

.94.987 

0.751: 

1;:144 

2930 

Over 

AAil 

QA  AT? 

HTia: 

i-:A77 

*5  A7Q 

103.453 

103.636 

100.890 

1.010 

2.177 

2.745 

Over 

103.501 

103.677 

NA 

1.015 

NA 

NA 

NA 

108.576 

108.077 

NA 

1.605 

NA 

NA 

NA 
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SPA  Fairness  Analyses 
SQTMOS  =  92B  Test: 

Sample: 


White/BIack  Subgroups 

SQT  Prediction  Composite  -  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQT  Score 


Group 

Total 

White 

Black 

Effect  Sae 

P  value 

N 

115 

55 

60 

Test 

MN 

96.345 

98.199 

94.646 

0  659 

Test 

SO 

5.392 

4.912 

5.287 

Criterion 

MN 

94.882 

100.519 

89.715 

Critenon 

SD 

20.709 

24.002 

15.639 

Slope 

0.872 

0.868 

0.398 

0.5263 

Intercept 

10.904 

15.241 

52.069 

a0302 

R-Square 

0.052 

0.032 

0.018 

Predictor  Score 

Predicted 

Performance  Score 

Standard  Error 

W-B  Score  Difference 

Whita 

Black 

Whita 

Black 

Valua 

Undar/Ovar 

84.072 

NA 

85.530 

NA 

4.474 

NA 

NA 

88.375 

91.951 

87.242 

7.120 

3.104 

4.708 

Over 

89.359 

92.805 

87.634 

6.556 

2.829 

5.171 

Over 

93  257 

96;21!4K;^ 

89;197 

4.503 

1066 

7.017 

Over 

96.346 

98.:8^!;':: 

90.414 

3  403 

2.102 

3454 

Over 

99.933 

lOt;^;;; 

9l:.842;;  :: 

3.377 

2.829 

10.141 

Over 

103.111 

104.741 

93.107 

4.503 

3.777 

11.634 

Over 

105.220 

106.572 

93.947 

5.555 

4.474 

12.625 

Over 

108.023 

109.005 

NA 

7.120 

NA 

NA 

NA 

110  - 
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SPA  Fairness  Analyses 
SQT  MOS  =  94B  Test: 

Sample: 


White/Biack  Subgroups 

SQT  Prediction  Composite  —  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQT  Score 


Test 

Test 

Criterion  Critenon 

Group 

N 

MN 

SD 

MN  SD 

Slope 

Intercept 

R-Square 

R 

Total 

3104 

97.382 

6.236 

97.468  18.304 

0,987 

1.352 

0.113 

0.336 

White 

1128 

101.310 

6.072 

102.069  17.486 

0.883 

12.564 

0.094 

0.307 

Black 

1976 

95,140 

5.121 

94.841  18.246 

0.973 

2.299 

0.075 

0.274 

Effect  Size 

0989 

Pvahje 

0  4319 

0.0443 

Predictor  Score 

Predicted 

Performance  Score  Standard  Error 

W-B  Score  Difference 

Whit« 

Black 

Wbit» 

Black 

Valutt 

Und*r/Ov«r 

84.898 

NA 

84.905 

NA 

0.883 

NA 

NA 

89.166 

91 .298 

89.058 

1.108 

0.607 

2.240 

Over 

90.019 

92.051 

89.887 

1,046 

0.558 

2.163 

Over 

95:238- 

96.6^;?:  : 

94.966  , 

0.7D1 

0,395 

1  694 

Over 

97.382 

98:1552::: 

97052:  ;  ;  i 

0  590 

0  431 

1  501 

Over 

100.261 

l0t;CS4.-:: 

93853::;.: 

0503 

0.558 

1  242 

Over 

105.382 

105.616 

104.836 

0.597 

0.883 

0.781 

Over 

107.382 

107.382 

NA 

0.701 

NA 

NA 

NA 

113.454 

112.744 

NA 

1.108 

NA 

NA 

NA 

115  - 

110  - 
Sl05i- 

f,oo: . 

i  »5  •  - 

D  -  • 

i  90  J 

ss  ‘  . 

eo  I - — 
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SPA  Fairness  Analyses 
SQT  MOS  =  95B  Test: 

Sample: 


White/Black  Subgroups 

SQT  Prediction  Composite  -  Reduced  Model 

Category  IIIB  &  IV  Soldiers 


Standardized  Written  SQT  Score 


Group 

N 

Test 

MN 

Test 

SO 

Criterion 

MN 

Criterion 

SO 

Siope 

Intercept  R-Square 

R 

Total 

3476 

94.853 

4.883 

94.849 

18.105 

1.009 

-0.854 

0.074 

0.272 

White 

2609 

96.116 

4.409 

96.283 

18.038 

1.030 

-2.726 

0.063 

0.251 

Black 

867 

91.052 

4.225 

90.532 

17.623 

0.803 

17.428 

0.037 

0.192 

Effect  Size 
PveHie' 

1.037 

. : 

ai5sa 

02931 

iiliiiii 

Predictor  Score 

Predicted  Performance  Score 

Standard  Error 

W-B  Score  Difference 

Whit* 

Black 

Whit* 

Black 

Valu* 

Und*r/Ov*r 

82.602 

NA 

83.757 

NA 

1.313 

NA 

NA 

86.827 

NA 

87.150 

NA 

0.831 

NA 

NA 

87.298 

87.191 

87.528 

0.764 

0.786 

-0.337 

Under 

-  mmmy  ^ 

"  ";;:;.:91v732-; : 

-:9i:.069:;  - 

0.483: 

Di594- 

0.663 

Over;' 

94;853;-;^  .  ' 

n  94.973 

93.595 

0.356 

0.790 

1.378 

Over-;;; 

^..:95:277:' 

- 

9319^.;:; 

0.348  .:. 

:  :o;831 

1  474< 

Over.:-;;'-; 

99.502 

99.761 

97.328 

0.431 

1.313 

2.433 

Over 

100.525 

100.815 

NA 

0.483 

NA 

NA 

NA 

104.934 

105.356 

NA 

0.764 

NA 

NA 

NA 

110  r 

I 
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Appendix  C 

EXPERT  JUDGEMENT  STUDY  MATERIALS 
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Background 


1 


We  are  interested  in  developing  selection  criteria  for  below-average  men  who  may 
want  to  enter  the  Army.  As  you  know,  Category  IIIBs  and  IVs  typically  do  not  perform  as 
well  as  average  and  above-average  recruits.  However,  this  doesn’t  mean  that  they  all  do 
poorly.  In  fact,  some  do  quite  weU.  One  goal  of  this  research  is  to  determine  if  there  are 
individual  characteristics  which,  if  measured  prior  to  accession  into  the  Army,  would  allow  us 
to  identify  below-average  individuals  who  will  make  good  soldiers.^  In  this  judgment  task 
we  are  attempting  to  capitalize  on  your  knowledge  and  experience  to  help  us  answer  this 
question. 

We  are  going  to  be  performing  a  wide  range  of  analyses  investigating  the  relationship 
between  background  and  performance  variables.  As  a  first  step,  though,  we  need  to  identify 
the  individual  characteristics  (or  predictors)  to  be  evaluated.  We  have  already  surveyed  past 
research  to  see  what  relationships  others  have  found  between  pre-service  characteristics  and 
in-service  performance.  The  resulting  list  of  variables  has  been  expanded  to  include  other 
logical  attributes  that  we  might  want  to  take  a  look  at.  The  final  list  we  came  up  with  has  19 
variables  on  it.  In  essence  this  is  the  pool  of  all  viable  predictors,  and  we’d  like  to  narrow  it 
down  somewhat  before  beginning  any  extensive  data  analysis.  Towards  that  end  we  are 
asking  for  your  input  regarding  the  merit  of  these  performance  predictors. 

What  we  are  asking  you  to  do  here  is  provide  estimates  of  how  strong  the  relationship 
is  between  each  of  the  19  predictor  variables  and  each  of  the  four  performance  criteria: 
Attrition,  Promotion,  Skill  Qualification  Test  (SQT)  Score,  and  Reenlistment  Eligibility. 

These  estimates  will  take  the  form  of  validity  coefficients.  If  you  are  familiar  with  the 
concept  of  validity,  you  can  skip  to  the  section  labeled  "General  Instructions  for  Making 
Judgments",  and  continue  with  the  task.  For  those  who  may  be  unsure  of  how  to  estimate 
validities,  the  next  section  is  provided  for  your  guidance. 


^  Obviously,  one  major  factor  that  effects  performance  is  the  individual’s  MOS.  We 
will  be  controlling  for  this  in  other  phases  of  the  study,  so  it  is  not  a  concern  here.  For 
the  purposes  of  this  task,  try  to  think  in  terms  of  the  performance  of  general  military 
duties,  such  as  those  found  in  the  Soldier’s  Manual  of  Common  Tasks  (e.g.,  navigation, 
use/maintain  weapon,  camouflage). 
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VaBdity 


2 


What  is  validity?  In  this  context,  it  is  the  strength  of  the  relationship  between  two 
variables--a  predictor  and  a  performance  measure.  The  value  of  a  validity  can  range  from 
zero  to  one.  The  closer  to  zero,  the  less  the  relationship.  An  example  might  clarify  this 
concept  as  well  as  the  estimation  task.  Say  we  are  trying  to  predict  rifle  range  test  scores  at 
the  end  of  marksmanship  training.  There  are  three  predictors  avaflable: 

•  Marital  Status-Never  Been  Married,  Married,  Divorced,  Separated, 
Widowed 

•  Control  Precision-the  ability  to  make  controlled  muscular  movements  in 
adjusting  machines  or  equipment. 

•  Mean  marksmanship  scores  from  the  final  two  weeks  of  training. 

Your  estimate  of  the  validity  of  these  three  predictors  would  be  based  on  your  perception  of 
how  directly  each  is  related  to  the  criteria-number  of  targets  hit  during  the  test-and  what 
percentage  of  the  variation  in  performance  it  is  likely  to  account  for. 

in  all  likelihood,  there  will  be  little  relationship  between  marital  status  and 
performance  on  the  marksmanship  test;  that  is,  the  correlation  would  be  close  to  zero. 
Correspondingly,  your  estimate  of  the  validity  of  this  variable  in  predicting  performance  on 
the  test  would  also  be  at  or  near  zero. 

The  control  precision  measure,  however,  may  be  related  to  the  ability  to  hold  and  aim 
a  rifle.  You  would  have  to  make  a  judgment  as  to  how  important  this  aspect  of  the  task  is 
relative  to  the  other  skills  and  factors  involved  (eyesight,  ability  to  handle  stress,  weather 
conditions),  and  assign  a  corresponding  validity  value.  In  the  end  you  may  decide  that  this  is 
an  important  factor,  but  given  the  other  characteristics  that  are  involved  it  would  probably 
only  correlate  moderately  with  performance.  In  that  case,  a  value  somewhere  in  the  .3  to  .4 
range  would  be  the  best  validity  estimate. 

Finally,  you  have  the  practice  performance  variable.  Clearly,  this  is  one  element  that 
we  would  expect  to  be  highly  related  to  performance  on  the  test.  Of  course  no  predictor  is 
perfect,  and  other  factors  can  come  into  play  that  weaken  the  relationship  between  practice 
and  test  performance.  For  instance,  how  people  feel  on  any  given  day,  the  degree  to  which 
stress  effects  performance,  and  so  on.  Still,  it  would  be  reasonable  to  expect  a  fairly  strong 
relationship  between  practice  and  test  performance,  with  a  validity  value  in  the  .6  to  .8 
range. 
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As  you  do  this  task,  there  are  undoubtedly  other  factors  that  will  come  to  mind  that 
could  cause  you  to  adjust  your  estimates.  There  are  three  in  particular  that  we  would  prefer 
you  ignore  to  the  extent  possible. 

First  there  is  the  problem  of  the  criterion  not  being  "perfect."  An  example  might  be  if 
you  were  trying  to  predict  bowling  or  golf  ability.  The  criterion  used  is  the  score  for  a  given 
game,  and  the  predictor  is  number  of  years  playing.  It  might  occur  to  you  that  one  game 
may  not  be  a  true  indicator  of  how  well  an  individual  actually  bowls  or  plays  golf. 

Therefore,  even  if  you  think  there  is  probably  a  strong  overall  relationship  between  number 
of  years  played  and  how  well  one  plays,  you  might  be  tempted  to  lower  your  estimate  under 
the  assumption  that  the  persons’  score  in  a  single  game  may  not  be  representative  of  their 
overall  ability.  For  the  purpose  of  this  task,  we  want  you  to  assume  that  each  criterion  is  a 
true  indicator  of  the  construct  it  represents.  In  other  words,  in  our  hypothetical  example  you 
would  assume  that  each  persons’  one-game  score  was  exactly  their  average;  that  it  was  a  true 
and  reliable  indicator  of  their  ability.  In  terms  of  the  present  task,  this  would  mean  you 
should  put  aside  any  questions  you  may  have  about,  for  instance,  SQT,  as  a  performance 
measure  and  assume  that  they  are  true  indicators  of  ability. 

A  second  problem  may  come  about  if  there  is  something  unique  or  different  about  the 
sample  for  which  you  are  making  estimates.  For  instance,  if  we  were  making  validity 
estimates  about  the  number  of  years  bowling/golfing  as  a  predictor  of  ability  based  on  a 
sample  of  professionals,  the  relationship  would  probably  be  weaker.  This  is  because  they 
wouldn’t  be  professionals  if  they  didn’t  play  at  a  unusually  high  level.  So,  their  scores  are  all 
likely  to  be  high  regardless  of  the  number  of  years  they  have  played.  For  the  purposes  of 
this  task,  we  would  like  you  to  assume  that  the  entire  range  of  values  are  found  for  both  the 
criterion  and  predictor  variables.  People  who  have  never  bowled  and  those  who  have  done 
so  for  years.  Individuals  who  score  0,  and  those  who  score  200. 

The  final  issue  concerns  sample  sizes.  As  you  could  probably  guess,  if  we  were  to  try 
to  establish  validity  based  on  a  sample  of  only  five  people  the  relationship  would  probably 
not  be  the  same  as  if  we  had  a  much  larger  sample.  With  a  large  sample  the  averages  more 
closely  reflect  what  would  be  found  in  the  population,  and  the  full  range  of  "scores"  on  the 
predictor  variable  can  be  found.  Therefore,  for  this  task  we  would  like  you  to  assume  that 
the  estimates  are  for  the  entire  population. 

In  summary,  we  would  like  you  to  estimate  the  "true  validities"— the  real  relationship 
between  predictors  and  criteria  without  such  potentially  attenuating  influences  as  unreliable 
criterion,  a  restriction  in  the  range  of  predictor  scores  (beyond  that  resulting  from  the 
restriction  to  below-average  persoimel),  or  small  sample  sizes. 

A  final  concept  you  need  to  know  to  do  this  task  is  that  of  incremental  validity.  This 
refers  to  the  predictive  power  of  a  given  variable  above  and  beyond  that  of  another  variable. 
In  this  task  you  will  be  asked  to  provide  validity  estimates  for  the  19  predictors  individually, 
and  then  to  make  a  second  set  of  estimates  of  their  predictive  power  after  taking  AFQT  score 
into  account.  If,  in  your  judgment,  the  predictor  in  question  is  unrelated  to  AFQT,  then  your 
validity  estimate  will  be  the  same  as  it  was  without  this  factor  included.  But,  there  may  be 
cases  where  you  feel  that  AFQT  and  the  predictor  are  related,  and  if  you  "subtract  out"  the 
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effect  of  aptitude  the  validity  of  the  new  predictor  would  be  decreased.  To  return  to  our 
earlier  example,  let’s  say  that  one  of  the  predictors  for  ability  to  bowl  or  play  golf  was  age. 
You  might  assume  that  an  older  person  has  played  longer  and,  therefore,  probably  is  better. 
Taking  all  other  factors  into  account,  you  assign  a  value  of  .5  as  the  validity  estimate.  Now  if 
we  were  to  ask  for  an  estimate  of  the  validity  of  age  as  a  predictor  after  taking  into  account 
years  played,  your  estimate  would  probably  be  a  good  deal  lower.  In  fact,  unless  you  feel 
that  there  is  some  other  association  between  age  and  ability,  your  estimate  of  incremental 
validity  might  drop  to  zero.  This  is  because  the  primary  association  between  age  and  ability 
is  accounted  for  by  the  number  of  years  one  has  played  the  game.  Age  itself  contributes 
nothing  beyond  this. 

To  summarize,  the  terms  you  need  to  know  to  perform  this  task  are: 

Validity-  The  power  of  one  variable  to  predict  another  as  represented  by 

the  strength  of  the  relationship  (or  correlation)  between  the 
two.  Values  range  from  .0  (no  validity)  to  1.0  (perfect 
correlation). 

True  Validity-  The  validity  of  a  predictor  when  the  criteria  are  true  indicators 

of  ability,  when  the  entire  range  of  predictor/criteria  scores  are 
included,  and  when  the  sample  is  representative  of  the 
population  as  a  whole. 

Incremental  Validity-  The  predictive  power  of  a  variable  after  the  effects  of  another 

predictor  have  been  taken  into  account.  Incremental  validity 
will  be  lower  to  the  extent  that  the  two  predictors  are  related 
and,  therefore,  account  for  the  same  sources  of  variation  in 
performance. 
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General  Instructions  for  Making  Judgments 


3 


Descriptions  of  19  predictor  constructs  and  four  criterion  factors  have  been  prepared 
for  your  use  in  this  task.  The  term  construct  is  used  to  signify  that  the  predictors  often 
represent  a  general  concept  (e.g.,  physical  conditioning)  rather  than  a  specific  measure  (e.g., 
Amy  Physical  Readiness  Test  score).  To  the  extent  that  you  can  disassociate  the  two,  we 
are  interested  in  your  estimates  of  the  validity  of  the  construct  rather  than  specific  measures 
of  it.  Generally,  we  are  asking  you  to  answer  three  types  of  questions  for  below-average 
aptitude  individuals: 

1.  What  is  the  degree  of  relationship  between  19  predictor  constructs  and  four  criterion 
factors? 

2.  Given  the  relationship  between  Armed  Forces  Qualification  Test  (AFQT)  score  and 
each  criterion  factor,  what  is  the  degree  of  relationship  between  the  predictor 
constructs  and  criterion  factors?  That  is,  what  additional  or  incremental  validity 
above  AFQT  would  each  predictor  contribute? 

3.  What  are  the  "best"  10  constructs  for  predicting  each  criterion  factor  given  the 
predictive  power  of  AFQT? 

Background  Information 

Please  complete  the  enclosed  Background  Information  form.  This  data  will  be  used  to 
describe  the  judges’  experience  regarding  testing  issues. 

Judgment  Materials 

1.  To  the  extent  information  was  available  and  relevant,  the  following  is  provided  for 
each  predictor  construct: 

’  name; 

*  definition  or  explanation; 

*  brief  summary  of  the  typical  measures; 

*  reliability  synopsis  of  the  measures; 

*  validity  synopsis  of  the  measures;  and 

»  sample  items  from  one  or  more  measures. 

2.  The  name  and  definition  or  description  of  each  criterion  factor  is  provided. 

3.  Enclosed  is  an  Initial  Validity  Judgment  Record  Sheet,  an  Incremental  Validity 
Judgment  Record  Sheet,  and  a  Rank  Order  Record  Sheet  on  which  you  should 
make  and  record  your  judgments.  You  have  four  (4)  sets  of  sheets  to  record  the 
various  estimates  for  below-average  aptitude  Army  personnel. 
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Instructions  for  Making  Your  Judgments 


Carefully  review  the  definitions  and/or  descriptions  associated  with  each  predictor 
construct  and  each  criterion  factor  so  that  you  are  familiar  with  the  enclosed  materials 
before  making  your  judgments.  As  a  word  of  caution,  some  of  the  constructs  are  not 
typically  used  as  predictors.  However,  in  identifying  potential  predictors  for  below-average 
aptitude  recruits,  we  did  not  want  to  prematurely  omit  any  predictor  constructs  that  might  be 
useful.  Several  of  these  potential  constructs  are  categorical  rather  than  continuous  variables. 
In  making  judgments  about  categorical  variables,  you  may  find  it  helpful  to  think  in  terms  of 
the  "relationship"  between  the  variable  and  the  criterion  rather  than  the  "validity"  of  the 
predictor  for  the  criterion.  Also,  please  note  that  the  scales  included  in  the  predictor 
construct  descriptions  are  intended  to  provide  examples  of  ways  that  the  construct  has  been 
measured  rather  than  restrict  the  way  the  construct  is  or  can  be  measured. 

Because  one  of  the  purposes  of  this  project  is  to  select  most  and  least  appropriate  MOS 
for  lower-aptitude  soldiers,  make  sure  that  each  of  your  judgments  (Initial  Validity, 
Incremental  Validity,  and  Rank  Ordering)  reflects  the  relationship  between  the  predictor 
constructs  and  criterion  factors  for  persons  of  below-average  ability  (i.e.,  AFQT  Categories 
IIIB  and  IV).  Therefore,  for  each  of  the  different  types  of  judgments  discussed  below,  you 
are  to  provide  estimates  for  CAT  IIIB  and  CAT  FV  level  Anny  personnel,  focussing  on  the 
latter.  Recall  that  CAT  IV  personnel  have  AFQT  scores  in  the  10  to  30  percentile  range 
and  CAT  IIIBs  score  from  31  through  49. 

A.  Initial  Validity  Judgments.  After  you  haye  a  grasp  of  the  descriptions  for  the  first 
predictor  construct  and  the  first  criterion  factor,  estimate  the  true  yalidity  of  the 
construct  for  that  criterion  factor.  (Keep  in  mind  that  we  are  asking  you  to  estimate 
the  true  yalidity  and  not  the  observed  validity  between  the  two,  as  was  discussed  in 
document  two.)  Write  your  estimate  in  the  appropriate  cell  on  the  record  sheet, 
limiting  your  responses  to  .05  intervals  of  the  .00  to  1.00  validity  coefficient  range 
(i.e.,  .00,  .05,  .10,  .  .  .,  .95,  1.00)  and  rounding  to  the  nearest  .05  interval,  as 
necessary. 

Next,  think  about  the  direction  of  the  relationship  between  the  two  variables.  If  you 
think  there  is  a  positive  relationship,  you  do  not  need  to  enter  a  "+"  in  front  of  the 
scale  value;  however,  if  you  think  there  is  a  negative  relationship  ^  sure  to  put  a  "-" 
in  front  of  the  value  (lack  of  a  negative  sign  will  be  taken  to  mean  a  positive  value). 
Caution  is  given  for  entering  negative  signs  due  to  the  fact  that  the  descriptions  for 
some  of  the  predictor  constructs  and  criterion  factors  are  a  bit  ambiguous  about  the 
meaning  of  high  scores;  for  the  most  part,  the  name  and  definition  make  clear  what 
a  high  score  represents.  Repeat  this  procedure,  estimating  separately  the  true 
validity  for  the  first  predictor  construct  and  each  of  the  three  criterion  factors 
remaining. 


Move  to  the  second  predictor  construct  and,  following  the  procedures  above,  make 
and  record  your  estimates  between  this  construct  and  each  criterion  factor. 

Continue  in  this  manner  until  you  have  estimated  separately  the  true  validity 
between  the  19  predictor  constructs  and  the  four  criterion  factors. 

Please  estimate  validities  for  below-average  (Categories  IIIB-IV)  and  above>average 
(Categories  I-IIIA)  Army  personnel  separately.  If  you  believe  that  the  coefficients 
for  these  two  groupings  are  the  same  please  indicate  so  by  repeating  your  estimate. 

B.  Incremental  Validity  Judgments.  Based  on  an  understanding  of  the  descriptions  of 
the  first  predictor  construct  and  the  first  criterion  factor,  estimate  the  true 
incremental  validity  over  the  validity  of  the  AFQT  of  the  construct  for  that  criterion 
factor.  (Remember  to  estimate  the  true  validity  and  not  the  observed  validity 
between  the  two  variables.)  Write  your  estimate  in  the  appropriate  cell  on  the 
record  sheet,  and  as  when  making  your  initial  validity  judgments,  limit  your 
responses  to  .05  intervals  of  the  .00  to  1.00  validity  coefficient  range. 

Repeat  this  procedure,  estimating  separately  the  true  incremental  .validity  over  the 
validity  of  the  AFQT  for  the  first  predictor  construct  and  each  of  the  three 
remaining  criterion  factors. 

Move  to  the  second  predictor  construct,  and  following  the  procedures  above,  make 
and  record  your  incremental  estimates  over  the  validity  of  the  AFQT  for  this 
construct  and  each  criterion  factor.  Continue  in  this  manner  until  you  have 
estimated  separately  the  true  incremental  validity  over  the  validity  of  the  AFQT 
between  the  19  predictor  constructs  and  the  four  criterion  factors. 

Again,  as  with  the  initial  validity  judgments,  please  enter  a  value  for  both  below- 
average  (Categories  IIIB  and  IV)  and  above-average  (Categories  I-IIIA)  Army 
personnel. 

C.  Rank  Ordering  the  Predictor  Constructs.  For  each  criterion  factor,  decide  which  10 
constructs  are  the  best  predictors.  In  ranking  the  predictors,  assume  that:  (a)  10 
separate  regression  equations  will  be  written  for  each  criterion  factor,  (b)  only  two 
predictors  vrill  be  entered  in  each  equation-AFQT  and  one  other  predictor,  and  (c) 
AFQT  will  always  be  entered  first. 

For  the  first  criterion  factor,  write  the  number  "1"  in  the  blank  to  the  left  of  the 
construct  that  you  feel  is  "the  best"  incremental  predictor  (i.e.,  the  predictor  that 
explains  the  greatest  amount  of  variance  over  AFQT).  Write  a  number  "2"  for  the 
construct  you  feel  is  the  "second  best"  predictor  (i.e.,  the  predictor  that,  when 
entered  after  AFQT  and  without  "the  best"  predictor,  explains  the  next  greatest 
amount  of  remaining  variance  over  AFQT).  Continue  with  this  process  until  you 
have  identified  the  10  "best"  predictors  for  that  criterion  factor. 

Move  to  the  second  criterion  factor,  and  following  the  procedures  above,  decide 
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which  10  constructs  are  the  'l)est"  predictors.  Continue  in  this  manner  until  you 
have  identified  separately  the  10  ''best"  predictors  for  each  of  the  four  cntenon 

factors. 


In  finishing,  check  to  be  sure  you  have  completed  all  the  judgments  and  that  you  have 
put  your  name  on  each  Record  Sheet.  Please  return  all  materials  to  Jamce  Laurence  by 
May  15,  1992  at  the  following  address: 

HumRRO 

66  Canal  Center  Plaza,  Suite  400 
Alexandria,  VA  22314 
Fax:  703' 

1 
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CONSTRUCT  NAME:  Education 


CONSTRUCT  NUMBER:  1 


DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

CONSTRUCT  NAME: 
DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

CONSTRUCT  NAME: 

DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 


Successful  completion  of  formal  training  through  four  years  of  high 
school 

High  School  Diploma  or  High  School  Transcripts 

Reliability  is  extremely  high-around  .99. 

Education  has  been  shown  to  be  related  to  many  performance 
outcomes  including  turnover,  promotion,  and  supervisory  ratings  of 
job  performance. 


Age  at  Enlistment  CONSTRUCT  NUMBER:  2 

Age  at  which  an  individual  joins  the  Army,  typically  17  to  21  years 
of  age 

Birthdate  as  shown  on  a  Birth  Certificate  compared  against 
Enlistment  Date 

Reliability  is  almost  perfect-about  ,99. 

Age  has  been  shown  to  be  related  to  intentions  to  leave  an 
organization  with  younger  employees  tending  to  change  jobs  more 
readily  than  older  workers.  It  has  also  been  shown  that  age  is 
related  to  absenteeism  with  higher  absentee  rates  reported  among 
younger  workers. 

Marital  Status/  CONSTRUCT  NUMBER:  3 

Number  of  Dependents 

Having  a  spouse  and/or  one  or  more  dependent  children 

Marriage  License;  Children’s  Birth  Certificates;  Adoption 
Certificates;  Court  degree  identifying  custodial  parent 

Reliability  is  very  high-around  .99. 

Validity  evidence  is  contradictory.  In  some  studies,  it  has  been 
shown  that  individuals  with  dependents  are  more  likely  to  separate 
prematurely  from  military  service.  In  other  studies,  the  reverse  has 
been  found. 
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CONSTRUCT  NAME:  Geographic  Region 


CONSTRUCT  NUMBER:  4 


DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

CONSTRUCT  NAME: 
DEFINITION: 

MEASURES: 


RELIABILITY: 

VALIDITY: 


State  or  region  in  which  one  was  bom  or  in  which  one  considers 
home 

Pencil  and  paper;  self-report 

Self-report  measures  tend  to  be  quite  accurate  with  reliabilities 
around  .94. 

Few  studies  have  looked  at  the  relationship  between  geographic 
region  and  job  performance  factors. 


Psychomotor  Abflities  CONSTRUCT  NUMBER:  5 

Motor  actions  directly  resulting  from  mental  activity.  For  example, 

•  Multilimb  Coordination  •  Aiming 

•  Manual  Dexterity  •  Arm-Hand  Steadiness 

•  Finger  Dexterity  •  Wrist-Finger  Speed 

Computerized  or  device-administered  tests  that  require  the 
respondent  to  perform  some  manipulations.  For  example,  the 
examinee  may  be  required  to  manipulate  one  or  more  controls  to 
track  a  stimulus  object.  The  examinee’s  score  is  time  on  target, 
root-mean-square  deviation,  or  another  related  measure.  For 
other  tasks,  the  respondent  may  be  asked  to  insert  pins  or  blocks 
into  holes  on  a  pegboard.  The  respondent’s  score  is  determined  by 
the  number  of  pins  or  blocks  inserted  within  a  given  amount  of 
time. 

Reliability  coefficients  range  from  .70  to  .90. 

There  is  a  dearth  of  validity  information  for  many  psychomotor 
constructs  and  an  abundance  of  information  for  other  constructs. 
Using  pilot  performance  as  the  criterion,  validity  coefficients  range 
from  .05  to  .25.  Against  academic  success,  coefficients  fall  between 
.05  and  .20.  In  predicting  job  performance  in  non-professional 
occupations,  coefficients  range  from  -.23  to  .60,  with  most 
occurring  between  .20  and  .30. 
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CONSTRUCT  NAME: 

DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

SAMPLE  ITEMS: 


Psychological  Variables  CONSTRUCT  NUMBER:  6 

(Temperament) 

Characteristic  tendencies  of  emotional  responses.  For  example, 

•  Need  for  Achievement  •  Cooperativeness 

•  Altruism .  •  Dominance 

•  Adjustment  •  Sodability 

•  Dependability  •  Conscientiousness 

Self-report  pencil  and  paper  measures  using  a  multiple  choice, 
True/False,  or  "indicate  the  most/least  descriptive  statement" 
format.  Examples  include  the  Recruit  Temperament  Survey 
(RTS),  Rotter  I-E  Scale,  Gordon  Persoria!  Profile-Inventory 
(GPPI),  the  California  Psychological  Inventory,  and  the  Assessment 
of  Background  and  Life  Experiences  (ABLE). 

Internal  consistencies  range  from  .57  to  .91,  with  most  values  in  the 
.80s.  Test-retest  reliabilities  are  around  .90  at  30-day  intervals  and 
around  .50  at  four-year  intervals. 

Median  validity  ranges  for  the  following  criteria: 


Education  -  grade  point  average 

-.16  to  .32 

Training  grades 

.08  to  .33 

Job  proficiency 

-.02  to  .25 

Job  involvementAVithdrawal 

-.09  to  .17 

California  Psychological  Inventory  -  Dominance 

Items  keyed  'True"  (i.e..  High  Dominance) 

•  I  think  I  would  enjoy  having  authority  over  other  people. 

•  I  have  a  natural  talent  for  influencing  people. 

•  When  the  community  makes  a  decision,  it  is  up  to  a  person  to 
help  carry  it  out  even  if  he  had  been  against  it. 

Items  keyed  "False"  (i.e..  Low  Dominance) 

•  I  doubt  whether  I  would  make  a  good  leader. 

•  I  must  admit  I  try  to  see  what  others  think  before  I  take  a 
stand. 

•  A  person  does  not  need  to  worry  about  other  people  if  only  he 
looks  after  himself. 
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CONSTRUCT  NAME:  Psychological  Variables  (Temperament)  (continued) 


Gordon  Personal  Profile-Inventory  -  Personal  Relations 
((Tooperativeness) 

Alternatives  keyed  "Least  Descriptive": 

•  becomes  irritated  by  faults  in  others 

•  doesn’t  trust  people  until  they  prove  themselves 

•  takes  offense  when  subjected  to  criticism 

Gordon  Personal  Profile-Inventory  -  Personal  Relations 
(Cooperativeness) 

Alternatives  keyed  "Most  Descriptive": 

•  accepts  criticism  with  good  grace 

•  very  tactful  and  diplomatic 

•  has  great  faith  in  people 
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CONSTRUCT  NAME: 

DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

SAMPLE  ITEMS: 


Biographical  Information  CONSTRUCT  NUMBER:  7 

Measures  an  individual’s  background  and  life  experiences 

Pencil  and  paper  forms  that  require  open-ended  or  yes/no 
responses  to  inquiries  about  an  individual’s  background  and  life 
experiences.  Biographical  Information  forms  may  also  use  a 
multiple  choice  format.  Sample  assessments  include  the 
Biographical  Information  Form  (BIF),  the  Biographical 
Information  Questionnaire  (BIQ),  the  Military  Applicant  Profile 
(MAP),  and  the  Armed  Services  Applicant  Profile  (ASAP). 

Correlations  of  .94  have  been  found  between  self-reported  biodata 
responses  and  later  verified  answers  to  the  same  questions. 

Overall  median  validity  coefficients  for  the  following  criteria: 


Training  performance 

.25 

Job  proficiency 

.32 

Job  involvement 

.30 

Adjustment 

.26 

Military  Applicant  Profile 

•  From  the  time  you  first  started  school,  how  many  times  did  your 
family  move  from  one  house  to  another? 


a.  None 

b.  1- 

c.  2 

d.  3 

e.  4  or  more 


•  How  old  were  you  when  you  first  began  to  support  yourself 
without  any  help  from  anyone  else? 

a.  16  or  younger 

b.  17 

c.  18 

d.  19  or  older 

e.  I  have  never  supported  myself 
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CONSTRUCT  NAME:  Interests 


CONSTRUCT  NUMBER:  8 


DEFINITION: 


MEASURES: 


RELIABUJTY: 

VAUDITY: 


SAMPLE  ITEMS: 


Preference  for  various  activities,  characteristics,  and  tasks  (e.g., 
routine  work,  manipulation  of  machines,  and  analytical  tasks) 

Pencil  and  paper  assessments  that  require  preference  ratings  for 
activities,  occupations,  school  subjects,  and  types  of  people. 
Example  inventories  include  the  Army  Qassification  Inventory,  the 
Army  Vocational  Interest-Career  Examination,  the  Job  Check  List, 
the  Strong-Campbell  Interest  Inventory,  the  Holland  Self-Directed 
Inventory,  and  the  Performance  Index. 

Reliabilities  of  various  inventories  range  from  .69  to  .98. 

Occupational  scores  on  various  scales  are  as  predicted.  For 
example,  artists  and  musicians  score  high  on  Artistic  Interest  Scales 
and  low  on  Realistic  Interest  Scales,  whereas  the  reverse  pattern  is 
found  for  carpenters  and  foresters.  Hit  rates  are  acceptable“25% 
to  58%~between  interest  inventories  and  occupational  choice. 
Correlations  with  job  satisfaction  are  around  .30;  around  .20  with 
job  proficiency;  and  around  .25  with  training  performance. 

Army  Classification  Inventory 
(indicate  yes  or  no) 

•  I  like  to  play  baseball. 

•  I  like  keeping  records. 

•  I  like  repairing  mechanical  toys. 

•  I  would  like  being  an  explorer. 

•  I  would  like  driving  a  truck. 

Army  Vocational  Interest-Career  Examination 
(for  which  degree  of  liking  is  indicated) 

•  Jobs 

•  Computer  operator 

•  Highway  patrol  officer 

•  Work  Tasks 

•  Take  blood  pressure  readings 

•  Deliver  cargo  on  time 


CX)NSTRUCT  NAME:  Interests  (continued) 


SAMPLE  ITEMS:  Army  Vocational  Interest-Career  Examination 

•  Spare  Time  Activities 

•  Tune-up  a  car 

•  Go  skydiving 

•  Desired  Learning  Experiences 

•  Telecommunications 

•  How  different  aircraft  look 
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CONSTRUCT  NAME:  Numerical  Operations 


CONSTRUCT  NUMBER:  9 


DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

SAMPLE  ITEMS: 


Speed  and  accura^r  in  performing  simple  arithmetic  operations 
(i.e.,  addition,  subtraction,  multiplication,  and  division) 

Pencil  and  paper  tests  that  require  the  examinee  to  perform  simple 
arithmetic  computations  and  to  record  the  answer  or  select  the 
correct  answer  from  among  several  alternatives. 

Alternate  forms  reliability  estimates  range  from  .75  to  .87,  with  a 
median  of  .84.  Test-retest  reliability  over  a  two-year  interval  has 
been  estimated  at  .75. 

Correlations  with  supervisory  ratings  of  job  performance  for 
clerical,  skilled,  and  semi-skilled  personnel  center  around  .25; 
validity  has  been  estimated  at  .41  for  technical  personnel. 
Correlations  with  training  outcome  scores  for  skilled,  semi-skilled, 
and  technical  personnel  center  around  .41.  The  median  correlation 
with  scores  on  the  Skill  Qualifications  Test  for  eight  Army  MOS  is 
.52. 

Armed  Services  Vocational  Aptitude  Battery  -  Numerical  Operations 


•  7  +  6  = 

a.  11 

b.  13 

c.  15 

d.  19 

•9x1  = 

a.  0 

b.  10 

c.  1 

d.  9 

•  12  +  4  = 

a.  3 

b.  8 

c.  16 

d.  2 
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CONSTRUCT  NAME:  Mathematical  Knowledge 


CONSTRUCT  NUMBER:  10 


DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

SAMPLE  ITEMS: 


Ability  to  use  simple  algebra  and  geometry  along  with  arithmetic 
skills  and  reasoning  power 

Pencil  and  paper  multiple  choice  tests.  Items  present  a  word 
problem.  The  respondent  must  determine  how  to  solve  the 
problem  and  identify  the  correct  solution  from  among  a  set  of 
alternatives 

Internal  consistency  reliability  estimate  for  a  sample  of  Air  Force 
recruits  was  .85.  Test-retest  reliability  estimates  were  .92  and  .99. 

Correlations  with  training  outcome  scores  are  .50  for  four  Army 
MOS.  Correlations  with  the  Skill  Qualifications  Test  for  eight 
Army  MOS  center  around  .53. 

Armed  Services  Vocational  Aptitude  Battery  -  Mathematics 
Knowledge 

•  A  section  of  pavement  which  is  10  feet  long  and  8  feet  wide 
contains  how  many  square  feet? 

a.  80  sq.  ft. 

b.  92  sq.  ft. 

c.  800  sq.  ft. 

d.  18  sq.  ft. 

•  When  2x  - 1  is  multiplied  by  10  the  result  is  70.  What  is  the 
value  of  X? 

a.  2 

b.  12 

c.  3 

d.  4 

•  If  an  engine  pumps  G  gallons  of  water  per  minute,  then  the 
number  of  gallons  pumped  in  half  an  hour  may  be  found  by 

a.  taking  one-half  of  G 

b.  dividing  60  by  G 

c.  ,  multiplying  G  by  30 

d.  dividing  30  by  G 
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CONSTRUCT  NAME:  Mechanical  Comprehension 


CONSTRUCT  NUMBER:  11 


DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

SAMPLE  ITEMS: 


Ability  to  learn,  comprehend,  and  reason  with  mechanical  terms. 
More  specifically,  the  ability  to  perceive  and  understand  the 
relationships  of  physical  forces  and  mechanical  elements  in 
practical  situations. 

Pencil  and  paper  multiple  choice  tests.  Items  often  contain 
pictures  or  diagrams  depicting  mechanical  relationslups,  and 
respondents  choose  one  correct  response  from  among  a  set  of 
alternatives. 


Ranges  from  .79  to  .86,  with  a  median  value  of  .83. 
Median  vahdities  for  the  following  criteria: 


•  Supervisory  ratings 

.34 

•  Training  grades 

.32 

•  Written  achievement  test  grades 

.40 

Armed  Services  Vocational  Aptitude  Battery 

-  Mechanical 

Comprehension 

t  11  II 

1 

L  -  -  - - --Ji  2 

’  The  figure  above  represents  a  water  tank  containing  water.  The 
number  1  indicates  an  intake  pipe  and  2  indicates  a  discharge 
pipe.  Of  the  following,  the  statement  which  is  least  accurate  is 
that  the 

a.  tank  will  eventually  overflow  if  water  flows  through  the 
intake  pipe  at  a  faster  rate  than  it  flows  out  through  the 
discharge  pipe 

b.  tank  will  empty  completely  if  the  intake  pipe  is  closed  and 
the  discharge  pipe  is  allowed  to  remain  open 

c.  water  in  the  tank  will  remain  at  a  constant  level  if  the  rate  of 
intake  is  equal  to  the  rate  of  discharge 

d.  water  in  the  tenk  will  rise  if  the  intake  pipe  is  operating 
when  the  discharge  pipe  is  closed 


C-20 


CONSTRUCT  NAME:  Mechanical  Comprehension  (continued) 


SAMPLE  ITEMS: 


Armed  Services  Vocational  Aptitude  Battery  -  Mechanical 
Comprehension 

*  Sweating  usually  occurs  on  pipes  that 

a.  contain  cold  water 

b.  contain  hot  water 

c.  are  chrome  plated 

d.  require  insulation 

•  If  all  of  the  following  objects  are  at  room  temperature,  which 
will  feel  coldest? 

a.  book 

b.  metal  spoon 

c.  wooden  chest 

d.  blanket 
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CONSTRUCT  NAME:  General  Science 


CONSTRUCT  NUMBER:  12 


DEFINITION: 

MEASURES: 


RELIABILITY: 

VALIDITY: 


SAMPLE  ITEMS: 


Knowledge  of  basic  scientific  principles 

Multiple  choice  pencil  and  paper  tests  that  assess  knowledge  of 
physical,  biologi^,  and  earth  sciences 

Internal  consistency  reliability  is  .77. 

Average  validity  for  time  to  complete  training  in  nine  Navy  jobs  is  - 
.06.  Average  correlation  with  final  course  grade  across  38  military 
jobs  is  .28. 

Armed  Services  Vocational  Aptitude  Battery  -  General  Science 

*  The  chief  nutrient  in  lean  meat  is 

a.  fat 

b.  starch 

c.  protein 

d.  carbohydrates 

*  Substances  which  hasten  chemical  reaction  time  without 
themselves  undergoing  change  are  called 

a.  buffers 

b.  colloids 

c.  reducers 

d.  catalysts 

»  An  eclipse  of  the  sun  throws  the  shadow  of  the 

a.  moon  on  the  sun 

b.  moon  on  the  earth 

c.  earth  on  the  sun 

d.  earth  on  the  moon 
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CONSTRUCT  NAME:  Perceptual  Speed  and 

Accuracy 


CONSTRUCT  NUMBER:  13 


DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

SAMPLE  ITEMS: 


Ability  to  perceive  visual  information  quickly  and  accurately  and  to 
perform  simple  processing  tasks  with  it  (e.g.,  comparisons) 

Speed  tests  that  involve  visual  stimuli.  The  respondent  may  be 
asked  to  follow  one  of  a  set  of  lines  to  identify  the  endpoint. 
Another  task  is  to  compare  two  numbers  or  figures  to  determine 
whether  they  are  identical  or  different.  Other  tasks  present  a  table 
or  graph  which  contains  the  responses  to  multiple  choice  questions. 

Ranges  from  .80  to  .91,  with  a  median  of  .86. 

Median  values  for  the  following  criteria: 


•  Instructor  rating  .26 

•  Supervisory  rating  .26 

•  Training  grades  ,24 

•  Written  job  performance  test  .21 

•  Hire  vs.  not  hire  decision  .48 


Armed  Services  Vocational  Aptitude  Battery  -  Coding  Speed 


Key 


bay . 

...7100 

dark... 

....1872 

mole.. 

....4386 

brain.. 

....3600 

half..... 

...1492 

nest.... 

..6663 

calf..... 

..9012 

igloo... 

,...1776 

shoe... 

...8080 

Answers 

A 

B 

C 

D 

E 

1. 

brain 

1776 

3600 

4386 

6663 

8080 

2. 

igloo 

1492 

1776 

1872 

7100 

9012 

3. 

shoe 

3600 

4386 

5486 

6663 

8080 
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CONSTRUCT  NAME:  General  Information 


CONSTRUCT  NUMBER:  14 


DEFINITION: 

MEASURES: 


RELIABILITY: 

VALIDITY: 


SAMPLE  ITEMS: 


General  knowledge  of  a  variety  of  subjects 

Pencil  and  paper  multiple  choice  tests  of  previously  acquired 
general  knowledge  of  an  assortment  of  topics  ranging  from  sports, 
geography,  mechanics,  weapons,  etc. 

Internal  consistency  reliability  is  .67. 

Average  validity  for  time  to  complete  training  in  nine  Navy  jobs  is  - 
.10.  Average  correlation  with  final  course  grade  is  .22  across  38 
military  jobs. 

Armed  Services  Vocational  Aptitude  Battery  -  General  Information  llj 

Lr'.-' 

*  The  "No.  00  Buck"  is  correctly  used  in  a 

a.  .30-06  rifle  against  a  moose  at  long  range 

b.  16-gauge  shotgun  against  pheasants 

c.  20-inch  barrel  carbine  against  a  deer  in  dense  cover 

d.  12-gauge  shotgun  against  a  bear 

*  A  regulation  baseball  diamond  is  a  90-foot  square;  a  softball 
diamond  is  a 

a.  60-foot  square 

b.  75-foot  square 

c.  90-foot  square 

d.  120-foot  square 

'  The  intake  and  exhaust  valve  stems  in  an  automobile  engine  are 
driven  by  the 

a.  transmission 

b.  crankshaft 

c.  camshaft 

d.  drive  shaft 
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CONSTRUCT  NAME:  Electronics  Information 


CONSTRUCT  NUMBER:  15 


DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 


SAMPLE  ITEMS: 


Knowledge  of  electrical  or  electronic  systems  and  operations 

Pencil  and  paper  measures  of  the  ability  to  apply  previously 
acquired  knowledge  in  the  areas  of  electricity  and  electronics 
toward  the  solution  of  problems  in  practical  situations.  Also 
assesses  knowledge  of  electricity,  radio  principles,  and  electronics. 

Internal  consistency  reliability  is  .87. 

Median  correlations  across  military  and  civilian  jobs  with  the 
following  criteria: 

•  Education  .22 

•  Training  outcomes  .38 

*  Job  proficiency  .21 

Armed  Services  Vocational  Aptitude  Battery  -  Electronics  Information 

*  What  does  the  abbreviation  AC  stand  for? 

a.  additional  charge 

b.  alternating  coil 

c.  alternating  current 

d.  ampere  current 


’  Which  of  the  following  has  the  least  resistance? 

a.  rubber 

b.  silver 

c.  wood 

d.  iron 

•  Flux  is  used  in  the  process  of  soldering  together  two  conductors 
in  order  to 

a.  provide  a  luster  finish 

b.  prevent  oxidation  when  the  connection  is  heated 

c.  maintain  the  temperature  of  the  soldering  iron 

d.  prevent  the  connection  from  becoming  overheated 
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CONSTRUCT  NAME:  Automotive  Information 


CONSTRUCT  NUMBER:  16 


DEFINITION: 

MEASURES: 


RELIABILITY: 

VAUDITY: 


SAMPLE  ITEMS: 


Knowledge  of  maintenance  and  repair  of  automotive  equipment 

Pencil  and  paper  multiple  choice  tests  that  measure  general 
knowledge  of  automobiles  and  automobile  engines 

Internal  consistency  reliability  .85. 

Average  correlation  with  final  course  grade  across  38  military  jobs 
is  .21.  Average  validity  for  time  to  complete  training  is  -.12  in 
nine  Navy  jobs. 

Armed  Services  Vocational  Aptitude  Battery  -  Automotive 
Information 

•  A  fuel  injection  system  on  an  automobile  engine  eliminates  the 
necessity  for 

a.  a  manifold 

b.  a  carburetor 

c.  spark  plugs 

d.  a  distributor 

»  A  torsion  bar  might  be  found  in  the 

a.  transmission 

b.  distributor 

c.  speedometer 

d.  suspension 

»  In  an  automobile  air-conditioning  system  fails  to  cool,  the  first 
check  to  make  is  for 

a.  leaks  in  the  hoses 

b.  malfunction  in  the  compressor 

c.  low  oil  level 

d.  storage  of  refrigerant 
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CONSTRUCT  NAME: 

DEFINITION: 

MEASURES: 

RELIABILITY: 

VALIDITY: 

SAMPLE  ITEMS: 


Shop  Information  CONSTRUCT  NUMBER:  17 

Knowledge  of  shop  terminology  and  practices  and  the  use  of  tools 

Pencil  and  paper  multiple  choice  tests  that  measure  general 
knowledge  and  familiarity  with  tools  and  practices  in  shop  activities 

Internal  consistency  reliability  .81. 

Mean  correlation  across  38  military  jobs  with  final  course  grade  is 
.21.  Average  validity  for  time  to  complete  training  in  nine  Navy 
jobs  is  -.10. 

Aimed  Services  Vocational  Aptitude  Battery  -  Shop  Information 

*  The  cut  of  a  file  refers  to  the 

a.  shape  of  its  handle 

b.  shape  of  its  edge 

c.  kind  of  metal  it  is  made  of 

d.  kind  of  teeth  it  has 

*  The  tip  of  a  soldering  iron  is  usually  made  of 

a.  iron 

b.  steel 

c.  lead 

d.  copper 

*  A  lathe  would  normally  be  used  in  making  which  of  the 
following  items? 

a.  a  baseball  bat 

b.  a  bookcase 

c.  a  hockey  stick 

d.  a  picture  frame 


CONSTRUCT  NAME:  Spatial  Ability 


CONSTRUCT  NUMBER:  18 


DEFINITION: 

MEASURES: 


RELIABE.ITY: 


VALIDITY: 


SAMPLE  ITEMS: 


Ability  to  visualize  or  rotate  objects  and  figures  in  space 

Pencil  and  paper  tests  that  require  the  respondent  to:  (a) 
determine  whether  two  drawings  represent  the  same  figure  which 
has  been  rotated  to  different  orientations  or  essentially  different 
figures;  (b)  mentally  restructure  a  figure  into  its  components  for 
manipulation;  (c)  identify  a  figure  that  is  embedded  .within  a 
pattern;  or  (d)  recall  the  locations  of  objects  on  a  rotated  map. 

Internal  consistency  reliability  estimates  range  from  .77  to  .91. 
Test-retest  reliabilities,  over  a  one-year  period,  are  in  the  low  .80s. 

Correlations  with  supervisory  ratings  range  from  .16  to  .48,  with 
most  around  .20.  Correlations  with  high  school  course  grades 
range  from  -.12  to  .69,  with  a  median  value  of  .24. 

Armed  Services  Vocational  Aptitude  Battery  -  Space  Perception 


u.  " 

1 

1 

8 

■<3 

12. 

A 

I'O 

Hidden  Figures  Test 

*  ■  e  0  c 
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CONSTRUCT  NAME:  Physical  Fitness 


CONSTRUCT  NUMBER:  19 


DEFTNmON: 


MEASURES: 


RELIABILITY: 

VALIDITY: 


SAMPLE  ITEMS: 


Physical  capacity  to  perform  exercise.  Comprised  of  three 
components:  (a)  strength  -  ability  to  lift  heavy  objects  once  (e.g., 
lift  a  full  55  gal.  drum  onto  a  truck);  (b)  aerobic  capacity  - 
cardiovascular  endurance;  and  (c)  muscular  endurance  -  ability  to 
lift  heavy  objects  over  time  (e.g.,  carry  a  70  lb.  rucksack  on  a  10 
mile  hike). 

Measures  of  body  fat  or  lean  body  mass  (e.g.,  skinfoid).  Physical 
ability  tests  that  require  the  examinee  to  lift  various  amounts  of 
weight  (e.g.,  incremental  dynamic  lift  test).  Tests  of  cardiovascular 
endurance  (e.g.,  step  test).  Military  Entrance  Physical  Strength 
Capacity  Test  (MEPSCAT)  measures  lean  body  mass,  strength, 
and  endurance. 

Reliability  is  extremely  high-about  .99. 

Strength  and  endurance  tests  predict  performance  in  common 
soldiering  tasks  with  multiple  Rs  ranging  from  .45  to  .67. 
Correlations  of  physical  ability  tests  with  job  sample  tests  range 
from  .50  to  .80.  Lean  body  mass  correlates  .20  with  Basic  Training 
attrition  for  males.  Leg  and  trunk  strength  correlate  .50  with  Basic 
Training  attrition  for  females. 

Military  Entrance  Physical  Strength  Capacity  Test 

’  Step  Test  -  measures  aerobic  capacity 

»  Examinees  step  25  times  per  minute  for  three  minutes  at 
three  step  heists:  10  cm,  20  cm,  and  30  cm  for  females; 
and  20  cm,  30  cm,  and  40  cm  for  males. 

•  Score  is  maximal  oxygen  consumption  corrected  for 
examinee  size,  examinee  age,  step  height,  and  stepping 
frequency. 

»  Incremental  Dynamic  Lift  Test  -  measures  strength 

’  Examinees  use  an  overhand  grip  to  lift  increasing  amounts  of 
weight  from  the  floor  to  72  inches  and  to  60  inches. 
Examinees  must  keep  their  backs  straight,  knees  bent,  and 
feet  flat  on  the  floor.  Examinees  must  lift  the  weight  in  one 
smooth  motion  and  need  not  hold  the  weight  at  the  72  or  60 
inch  markers.  No  rests  are  allowed. 

’  Two  scores:  weight  successfully  lifted  to  72  and  60  inches. 
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CONSTRUCT  NAME:  Physical  Fitness  (continued) 


»  Lean  Body  Mass 

•  Score  is  sum  of  four  skinfold  measures  (biceps,  triceps, 
subscapular,  and  suprailiac)  measured  in  millimeters  and 
corrected  for  age  and  gender. 
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Attrition 

Attrition  is  defined  as  separating  from  the  Army  before  completion  of  the 
contracted  term  of  service  for  pejorative  reasons.  Attrition  for  nonpejorative 
reasons  such  as  disability,  death,  entry  into  officer  programs,  retirement, 
secretarial  authority,  sole  surviving  son,  or  breach  of  contract  by  the  Army  are 
not  included  in  this  criterion  factor. 

Early  separation  may  be  initiated  by  the  soldier  or  by  the  Army.  A  solider  may 
initiate  separation  procedures  through  administrative  procedures  (e.g., 
pregnancy)  or  by  deserting.  The  Army  may  discharge  a  soldier  through 
administrative  (i.e.,  medical,  homosexual,  or  disciplinary  chapters)  or  judicial 
(i.e,,  court  martial)  actions. 

Skill  Qualification  Test  (SQT)  Score 

The  SQT  is  a  written,  multiple-choice  test  used  to  evaluate  a  soldier’s  technical 
knowledge  of  his  or  her  Military  Occupational  Specialty  (MOS)  and  skill  level 
proficiency.  Depending  on  the  MOS,  the  test  takes  approximately  two  hours  to 
complete,  and  all  soldiers  in  Skill  Levels  1  through  4  are  tested  annually  in  their 
primary  MOS.  The  SQT  is  scheduled  in  advance,  and  soldiers  are  allowed  to 
study  for  the  test. 

Promotion 

Advancement  in  the  Army  depends  on  factors  that  are  both  internal  and 
external  to  a  soldier’s  control.  Internal  control  factors  include  SQT 
performance  and,  to  some  extent,  supervisory  ratings.  External  control  factors 
include  time  in  grade  (e.g.,  soldiers  are  generally  awarded  the  rank  of  E-2  upon 
completion  of  basic  training),  manpower  needs,  policy  decisions,  and  the 
number  of  openings  within  an  MOS. 

Reenlistment  Eligibility 

Reenlistment  eligibility  is  a  soldier’s  suitability  for  extending  his  or  her  time  in 
the  Army  beyond  the  initial  commitment.  It  is  often  used  as  a  summary 
indicator  of  success  in  the  Army.  Individual  achievements  as  measured  by  SQT 
performance,  supervisor  ratings,  and  promotions  influence  reenlistment 
eligibility.  However,  factors  outside  a  soldier’s  control  also  affect  reenlistment 
eligibility  including  manpower  needs,  policy  decisions,  and  the  number  of 
openings  within  an  MOS. 


Criterion  Construct  Summary  Information 
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Background  Information 


Name 

Date 

Education: 

Undergraduate 

Years  Completed 
Degree  Received 
Major  Area _ 

Graduate 

Years  Completed 

Degree  Received , 

Maior  Area 

Psychological  Testing  Training/Experience: 

Please  indicate  your  experience  with  the  foUowmg  psycholo^cal  testing  tasks.  Response  by  circling  Yes  or  No  after 
each- experience  statement. 


Development/ 

Heard  about  this  task  in  undergraduate  course(s)  or  general  sources 

Yes 

No 

Design  of  Cognitive 

Studied  this  task  in  graduate  course(s)  or  studied  in  depth  on  my  own 

Yes 

No 

Tests 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

Performed  this  task  without  supervision 

Yes 

No 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 

Development/ 

Heard  about  this  task  m  undergraduate  course(s)  or  general  sources 

Yes 

No 

Design  of  Physical 

Studied  this  task  in  graduate  course(s)  or  studied  in  depth  on  my  own 

Yes 

No 

Ability  Tests 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

Performed  this  task  without  supervision 

Yes 

No 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 
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Development/ 

Heard  about  this  task  in  undergraduate  course(s)  or  general  sources 

Yes 

No 

Design  of 

Studied  this  task  in  graduate  course(s)  or  studied  in  depth  on  my  own 

Yes 

No 

Psychomotor  Tests 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

Performed  this  task  without  supervision 

Yes 

No 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 

Development/ 

Heard  about  this  task  in  undergraduate  coiu-se(s)  or  general  sources 

Yes 

No 

Design  of 

Studied  this  task  in  graduate  course(s)  or  studied  in  depth  on  my  own 

Yes 

No 

Interest  Inventories 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

Performed  this  task  without  supervision 

Yes 

No 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 

Research  on  the 

Heard  about  this  task  in  undergraduate  course(s)  or  general  sources 

Yes 

No 

Relationship  of 

Studied  this  task  in  graduate  course(s)  or  studied  m  depth  on  my  own 

Yes 

No 

Cognitive  Tests  to 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

Other  Variables 

Performed  this  task  without  supervision 

Yes 

No 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 

Research  on  the 

Heard  about  this  task  in  undergraduate  course(s)  or  general  sources 

Yes 

No 

Relationship  of 

Studied  this  task  in  graduate  course(s)  or  studied  in  depth  on  my  own 

Yes 

No 

Physical  Ability 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

Tests  to  Other 

Performed  this  task  without  supervision 

Yes 

No 

Variables 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 
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Research  on  the 

Heard  about  this  task  in  undergraduate  course(s)  or  general  sources 

Yes 

No 

Relationship  of 

Studied  this  task  in  graduate  course(s)  or  studied  in  depth  on  my  own 

Yes 

No 

Psychomotor  Tests 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

to  Other  Variables 

Performed  this  task  without  supervision 

Yes 

No 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 

Research  on  the 

Heard  about  this  task  in  undergraduate  course(s)  or  general  sources 

Yes 

No 

Relationship  of 

Studied  this  task  in  graduate  course(s)  or  studied  in  depth  on  my  own 

Yes 

No 

Interest  Inventories 

Performed  parts  of  this  task  under  supervision 

Yes 

No 

to  Other  Variables 

Performed  this  task  without  supervision 

Yes 

No 

Supervised  others  performing  this  task 

Yes 

No 

Taught  this  task  to  others 

Yes 

No 

Wrote  a  scholarly  article  or  book  about  this  task 

Yes 

No 

Military  Task  Experience: 

Please  mdicate  your  knowledge  of  and  experience  with  the  military. 
Have  you  learned  about  the  military  through  close  family  members? 
Have  you  done  consulting  work  with  the  military? 

Have  you  served  in  the  military? 


Yes 

Yes 

Yes 


No 

No 

No 


Please  indicate  your  knowledge  of  and  experience  with  the  following  Army  activities.  Use  the  following  rating  scale 
to  indicate  your  responses. 

0  =  I  am  not  at  aU  familiar  with  this  activity. 

1  =  I  am  somewhat  familiar  with  this  activity. 

2  =  I  am  very  familiar  with  this  activity.  ' 

_  Conditions  under  which  a  soldier  may  initiate  early  separation  procedures  from  the  Army 

_  Conditions  under  which  the  Army  may  initiate  early  separation  procedmes  against  a  soldier 

_  Skill  Qualifications  Test  development 

_  Skill  Qualifications  Test  administration 

_  Promotion  eligibility  requirements 

_  Reenlistment  eligibility  requirements 
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INITIAL  VALIDITY  JUDGMENT  RECORD  SHEET 
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10.  Mathematical  Knowledge 


INITIAL  VALIDITY  JUDGMENT  RECORD  SHEET 
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INCREMENTAL  VALIDITY  JUDGMENT  RECORD  SHEET 
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10.  Mathematical  Knowledge 


INCREMENTAL  VALIDITY  JUDGMENT  RECORD  SHEET 


C-38 


Name: 


Rank  Order  Record  Sheet 

Estimates  for  Below-Average  Aptitude  Army  Personnel 


SQT  Score 
Education 


Age  at  Enlistment 


Attrition 

Education 

Age  at  Enlistment 

Marital  Status/ 

Number  of  Dependents 

Geographic  Region 

Psychomotor  Abilities 

Psycholo^cal  Variables 

Biographical  Information 

Interests 

Numerical  Operations 
Mathemadcal  Knowledge 
Mechanical  Comprehension 
General  Science 
Perceptual  Speed  and  Accuracy 
General  Informadon 
Electronics  Information 
Automotive  Information 
Shop  Information 
Spatial  Ability 
Physical  Fitness 


Marital  Status/ 

Number  of  Dependents 

Geographic  Region 

Psychomotor  Abilides 

Psychological  Variables 

Biographical  Information 

Interests 

Numerical  Operadons 
Mathemadcal  Knowledge 
Mechanical  Comprehension 
General  Science 
Perceptual  Speed  and  Accuracy 
General  Informadon 
Electronics  Information 
Automotive  Information 
Shop  Information 
Spadal  Ability 
Physical  Fitness 


Rank  Order  Record  Sheet 

Estimates  for  Below-Average  Aptitude  Army  Personnel 


Promotion 

Education 

Age  at  Enlistment 

Marital  Status/ 

Number  of  Dependents 

Geographic  Re^on 

Psychomotor  Abilities 

Psycholopcal  Variables 

Biographical  Information 

Interests 

Numerical  Operations 
Mathematical  Knowledge 
Mechanical  Comprehension 
General  Science 
Perceptual  Speed  and  Accuracy 
General  Information 
Electronics  Information 
Automotive  Information 
Shop  Information 
Spatial  Ability 
Physical  Fitness 


Reenlistment  Eligibility 

Education 

Age  at  Enlistment 

Marital  Status/ 

Niunber  of  Dependents 

Geographic  Region 

Psychomotor  Abilities 

Psychological  Variables 

Biographical  Information 

Interests 

Numerical  Operations 
Mathematical  Knowledge 
Mechanical  Comprehension 
General  Science 
Perceptual  Speed  and  Accuracy 
General  Information 
Electronics  Information 
Automotive  Information 
Shop  Information 
Spatial  Ability 
Physical  Fitness 
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Appendix  D 

Initial  and  Incremental  Validity  Estimates 
Tukey  Tests  of  Aptitude  by  Criterion  by  Predictor  Interactions 


D-1 


Table  D-1 

Tukey  Tests  of  Aptitude  by  Criterion  by  Predictor  Interactions 
Initial  Validity  Estimates:  Attrition 


CAT 

CAT 

Predictor 

niB-iv 

Predictor 

i-niA 

Education 

.340 

Education 

.293" 

Biographical  Information 

.300® 

Biographical  Information 

.280" 

Psychological  Variables 

.283" 

Psychological  Variables 

.280" 

Interests 

.253 

Interests 

.213'’ 

Physical  Fitness 

.216 

Physical  Fitness 

.190'’® 

Age  at  Enlistment 

.197 

Age  at  Enlistment- 

.186® 

Marital  Status/ 

.137 

Marital  Status/ 

.110“ 

Number  of  Dependents 

Number  of  Dependents 

Mathematical  Knowledge 

.110'’ 

Spatial  Ability 

.096“® 

Spatial  Ability 

.106'’® 

Mechanical  Comprehension 

.095“® 

Electronics  Information 

.097'’“' 

Mathematical  Knowledge 

.090“® 

Mechanical  Comprehension 

.096'’®^ 

Electronics  Information 

.087“® 

Psychomotor  Abilities 

.094'^' 

Automotive  Information 

.083® 

Perceptual  Speed  and  Accuracy 

.093'’®^ 

General  Information 

.083® 

Automotive  Information 

.090'’®^ 

Psychomotor  Abilities 

.080® 

Shop  Information 

.086“' 

Perceptual  Speed  and  Accuracy 

.080® 

General  Information 

.084“' 

General  Science 

.077® 

Numerical  Operations 

.084“' 

Shop  Information 

.073® 

General  Science 

.080“ 

Numerical  Operations 

.071® 

Geographic  Region 

.047 

Geographic  Region 

.037 

Tukey  =  .0250,  Alpha  =  .05,  K 

=  38,  MSE 

=  3.141,  DFE  =  755,  N  =  15 

Note.  Within-AFOT  Category  values  with  same  letter  not  significantly  different. 

Significant  differences  between  aptitude  levels: 

CAT 

CAT 

IIIB-IV 

I-IIIA 

Education 

.340 

.293 

Interests 

.253 

.213 

Marital  Status/ 

.137 

.110 

Number  of  Dependents 


Tabte  D-2 

Tokev  Tests  of  Aptitude  by  Ottcrion  by  Predictor  Interactiot® 
Lw^aKdity  Estimates;  SQfT  Score 


Pref^ctor 


CAT 

Ttm-TV  Predictor 


CAT 

I-rOA 


Mathematical  Knowledge 
Mechanical  Comprehension 
Numerical  Operations 
Spatial  Ability 
]^ucation 
General  Science 
Electronics  Information 
Automotive  Information 
General  Information 
Perceptual  Speed  and  Accuracy 
Shop  Information 
Interests 

Psychomotor  Abilities 
Biographical  Information 
Psychological  Variables 
Physical  Fitness 
Age  at  Enlistment 
Geographic  Region 
Marital  Status/ 

Number  of  Dependents 


.363 

.32(P 

.306*'’ 

.30(P'’ 

,'25y^ 

.240^ 

.236^ 

.226^ 

.213* 

,213“ 

.180^ 

.163^ 

,156^ 

.136 

,1168 

.097* 

.046** 

.036** 


Mathematical  Knowledge 
Mechanical  Comprehension 
Numerical  Operations 
Spatial  Ability 
Mucation 
General  Science 
Electronics  Information 
General  Information 

Automotive  Information 
Perceptual  Speed  and  Accuracy 
Shop  Information 
Interests 

Psychomotor  Abilities 
Biographical  Information 
Psychological  Variables 
Physical  Fitness 
Age  at  Enlistment 
Geographic  Region 
Marital  Status/ 

Number  of  Dependents 


.366 

.316? 

,293"** 

280**“ 

.250**“ 

.230**^ 

.226^8 

.223S 

.203** 

.196** 

.170* 

.153« 

.150*j 

.136>** 

.116** 

.084 

.036* 

.030* 


Taksy  -  .0250,  Alpha  =  .05,  K  =  38,  MSB  =  3.141,  DP?  =  755,  N  -  15 

Mnte.  Within-AFQT  category  values  with  same  letter  not  significant^  diaeient 
No  significant  differences  between  aptitude  levels. 
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e/s 


aawd 


eisii  t3G0<!.  -  a  I 


add=MOdd  fes=Ei  BB-0i-Nnr 


Table  D-3 

Tukey  Tests  of  Aptitude  by  Oritcrion  by  Predictor  Interactions 
initial  Validtiy  Estimates:  Promotion 


Predictor 

CAT 

niB-iv 

Predictor 

cat’ 

i-mA 

Education 

.266* 

Education 

.246* 

Physical  Fitness 

.260* 

Physical  Fitness 

.246* 

Ptychological  Variables 

.233 

P^chological  Variables 

.233* 

Biographical  Information 

.193 

Biographical  Information 

.186’’ 

Interests 

.186^’ 

Interests 

,166*^ 

Mathematical  Knowledge 

-180*’ 

Mathematical  Knowledge 

173bc 

Mechanical  Comprehension 

Mechanical  Comprehemion 

.173^ 

Spatial  Ability 

General  Information 

.150”* 

Age  at  Enlistment 

.150*^ 

Spatial  Ability 

.14(7* 

General  Information 

.146'*'? 

at  Enlistment 

.14<7* 

General  Science 

General  Science 

.13(7** 

Perceptual  Speed  and  Accuracy 

.136^*^ 

Perceptual  Speed  and  Accuracy 

.133^ 

Electronics  Information 

.133^**^ 

Electronics  Information 

.133*** 

Numerical  Operations 

.127*^ 

Numerical  Operations 

.  -13(7“= 

Automotive  Information 

.126*^2 

Automotive  Monnation 

.126^* 

Shop  Information 

.116^® 

Shop  Mormation 

.116** 

Psychomotor  Abilities 

.1068 

Psychomotor  Abilities 

.100* 

Marital  Status/ 

.080 

Marital  Status/ 

.073 

Number  of  Dependents 

Number  of  Dependents 

Geographic  Region 

.040 

Geographic  Region 

.023 

Tukey  =  .0250,  Alpha  =  .05,  K  =  38,  MSE  =  3.141,  DFE  =  755,  N  =  15 

Note.  Within-AFQT  category  values  with  same  letter  not  significantly  different. 
No  significant  differences  between  aptitude  levels. 
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EisiAiaEOi =ai 
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Table  D-4 

Tukey  Tests  of  Aptitude  by  Criterion  by  Predictor  Interactions 
Initial  Validity  Estimates:  Reenlistment  Eligibility 


Predictor 

CAT 

IIIB-IV 

Predictor 

CAT 

MIIA 

Education 

.253 

Education 

.243** 

Physical  Fitness 

.230 

Physical  Fitness 

lie 

Psychological  Variables 

.200 

Psychological  Variables 

.200 

Biographical  Information 

.17(P 

Biographical  Information 

.166” 

Interests 

.156^'’ 

Mathematical  Knowledge 

.150”^ 

Mathematical  Knowledge 

.154*"’ 

Mechanical  Comprehension 

.143”^ 

Mechanical  Comprehension 

.134‘* 

Interests 

.140" 

General  Information 

.123“* 

General  Information 

.130"" 

Numerical  Operations 

.120“* 

Numerical  Operations 

.123""" 

Spatial  Ability 

.118“** 

Spatial  Ability 

.114""^ 

Age  at  Enlistment 

114cdef 

Age  at  Enlistment 

110"efg 

General  Science 

llOcdcfg 

Electronics  Information 

108"ef8h 

Electronics  Information 

.lOS"*^* 

General  Science 

.103"f8h 

Perceptual  Speed  and  Accuracy 

.100"'^* 

Perceptual  Speed  and  Accuracy 

.100"f8h 

Automotive  Information 

.096*^8 

Automotive  .Information 

.096f8h 

Psychomotor  Abilities 

.090^8 

Shop  Information 

.0868” 

Marital  Status/ 

.0868 

Psychomotor  Abilities 

.083” 

Number  of  Dependents 

Marital  Status/ 

.083” 

Shop  Information 

.0868 

Number  of  Dependents 

Geographic  Region 

.033 

Geographic  Region 

.030 

Tukey  =  .0250,  Alpha  =  .05,  K  =  38,  MSE  =  3.141,  DFE  =  755,  N  =  15  ' 

Note.  Within-AFQT  category  values  with  same  letter  not  significantly  different. 
No  significant  differences  between  aptitude  levels. 
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Table  D-5 

Tukey  Tests  of  Aptitude  by  Criterion  by  Predictor  Interactions 
Incremental  VaHdity  Estimates:  Attrition 


Predictor 

CAT 

IIIB-IV 

Predictor 

CAT 

I-IIIA 

Biographical  Information 

.216* 

Biographical  Information 

.196* 

Psychological  Variables 

.210*'’ 

Psychological  Variables 

.196* 

Education 

.196^ 

Education 

.173 

Interests 

.178=^ 

Physical  Fitness 

.136" 

Physical  Fitness 

.160^ 

Interests 

.134" 

Age  at  Enlistment 

.133 

Age  at  Enlistment ' 

.123 

Marital  Status/ 

.104 

Marital  Status/ 

.084 

Number  of  Dependents 

Number  of  Dependents 

Psychomotor  Abilities 

.060* 

Psychomotor  Abilities 

.047* 

Spatial  Ability 

.053*^ 

Spatial  Ability 

.040*^ 

Perceptual  Speed  and  Accuracy 

.036^8 

Mathematical  Knowledge 

.028“** 

Numerical  Operations 

.033*'* 

Perceptual  Speed  and  Accuracy 

.026“* 

Mathematical  Knowledge 

.030*'’ 

Numerical  Operations 

.023“* 

Automotive  Information 

.0268*’ 

Automotive  Information 

.023“* 

Mechanical  Comprehension 

.023" 

Electronics  Information 

.020* 

Electronics  Information 

.023" 

General  Information 

.020* 

Shop  Information 

.023" 

Geographic  Region 

.020* 

General  Information 

.020" 

Shop  Information 

.018* 

Geographic  Region 

.020" 

Mechanical  Comprehension 

.017* 

General  Science 

.020" 

General  Science 

.016* 

Tukey  =  .0202,  Alpha  =  .05,  K  =  38,  MSE  =  2.061,  DFE  =  756,  N  =  15 

Note.  Within-AFQT  category  values  with  same  letter  not  significantly  different. 
Significant  differences  between  aptitude  levels: 


CAT 

CAT 

IIIB-IV 

I-IIIA 

Biographical  Information 

.216 

.196 

Education 

.196 

.173 

Interests 

.178 

.134 

Physical  Fitness 

.160 

.136 

Marital  Status/Num  Depend 

.104 

.084 
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Table  D-6 

Tukey  Tests  of  Aptitude  by  Criterion  by  Predictor  Interactions 
Incremental  Vali^ty  Estimates:  SQT  Score 


CAT 

CAT 

.Predictor 

iiiB-rv 

Predictor 

I-IIIA 

Education 

.114“ 

Interests 

.100“ 

Perceptual  Speed  and  Accuracy 

.110“^’ 

Perceptual  Speed  and  Accuracy 

.096“" 

Interests 

.106“*^ 

Spatial  Ability 

.093“"* 

Spatial  Ability 

.103“*^ 

Education 

.090“"*** 

Mechanical  Comprehension 

.093*^ 

Mechanical  Comprehension 

.080“"*** 

Psychological  Variables 

090bcde 

Biographical  Information 

.076"*“* 

Biographical  Information 

.086“^ 

Psychological  Variables 

.073*“* 

Psychomotor  Abilities 

.082*** 

Electronics  Information 

.070“*^ 

Electronics  Information 

073def 

Mathematical  Knowledge 

.070“*' 

Mathematical  Knowledge 

.070*^« 

Physical  Fitness 

.070“*' 

Physical  Fitness 

.070*^* 

Psychomotor  Abilities 

.068*' 

Automotive  Information 

.070*^* 

Automotive  Information 

.063*'8 

Shop  Information 

.066^8 

Shop  Information 

.060*'8 

General  Information 

.056^8** 

General  Information 

.050'8 

Age  at  Enlistment 

.053^8h 

General  Science 

.0468 

General  Science 

.0508** 

Age  at  Enlistment 

.0438 

Numerical  Operations 

.043*' 

Numerical  Operations 

.0438 

Marital  Status/ 

.013' 

Marital  Status/ 

.013" 

Number  of  Dependents 

Number  of  Dependents 

Geographic  Region 

.006' 

Geographic  Region 

.006" 

Tukey  =  .0202,  Alpha  =  .05,  K  = 

38,  MSE  = 

=  2.061,  DFE  =  756,  N  =  15 

Note.  Values  within  AFOT  category  with 

same  letter  not  significantly  different. 

Significant  differences  between  aptitude  levels: 

CAT 

CAT 

IIIB-IV 

I-IIIA 

Education 

.114 

.090 

Perceptual  Speed  and  Accuracy 

.110 

.096 
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Table  D-7 

Tukey  Tests  of  Aptitude  by  Criterion  by  Predictor  Interactions 
Incremental  Validity  Estimates:  Promotion 


Predictor 

CAT 

IIIB-IV 

Predictor 

CAT 

I-IIIA 

Physical  Fitness 

.166" 

Physical  Fitness 

.150" 

Psychological  Variables 

.150" 

Psychological  Variables 

.146" 

Education 

.114'’ 

Biographical  Information 

.103” 

Biographical  Information 

.no” 

Education 

.100” 

Age  at  Enlistment 

.103” 

Age  at  Enlistment 

.093” 

Interests 

.094” 

Interests 

.093” 

Perceptual  Speed  and  Accuracy 

.056*= 

Perceptual  Speed  and  Accuracy 

.053*= 

Spatial  Ability 

.056' 

Marital  Status/ 

.053*= 

Marital  Status/ 

.053^ 

Number  of  Dependents 

Number  of  Dependents 

.053“' 

Spatial  Abihty 

.040“* 

Psychomotor  Abilities 

.042“" 

Mechanical  Comprehension 

.034** 

Mechanical  Comprehension 

.034*" 

Psychomotor  Abilities 

.032“ 

Mathematical  Knowledge 

.034*"^ 

Mathematical  Knowledge 

.030“' 

General  Information 

.033*"^ 

Automotive  Information 

.028“' 

Automotive  Information 

.031'^ 

General  Information 

.026“' 

Electronics  Information  . 

.028*=^ 

Electronics  Information 

.024“' 

Shop  Information 

.028*^ 

Shop  Information 

.024“' 

General  Science 

.023*'^8 

General  Science 

.023“'* 

Numerical  Operations 

.016^8 

Numerical  Operations 

.013'* 

Geographic  Region 

.0038 

Geographic  Region 

.003* 

Tukey  =  .0202,  Alpha  =  .05,  K  =  38,  MSE  =  2.061,  DFE  =  756,  N  =  15 

Note.  Within-AFQT  category  values  with  same  letter  not  significantly  different. 
No  significant  differences  between  aptitude  levels. 
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Table  D-8 

Tukey  Tests  of  Aptitude  by  Criterion  by  Predictor  Interactions 
Incremental  Validity  Estimates:  Reenlistment  Eligibility 


Predictor 

CAT 

IIIB-IV 

Predictor 

CAT 

MIIA 

Physical  Fitness 

.156 

Physical  Fitness 

.143 

Psychological  Variables 

.130 

Psychological  Variables 

.126 

Education 

.106* 

Education 

.103* 

Biographical  Information 

.094*** 

Biographical  Information 

.088**’ 

Interests 

.081^* 

Interests 

.081*’ 

Age  at  Enlistment 

.080*’ 

Age  at  Enlistment  ■ 

.080*= 

Marital  Status/ 

.046*= 

Marital  Status/ 

.050' 

Number  of  Dependents 

Number  of  Dependents 

Spatial  Ability 

.043*= 

Perceptual  Speed  and  Accuracy 

.038“* 

Perceptual  Speed  and  Accuracy 

.038”* 

Spatial  Ability 

.036“*' 

Psychomotor  Abilities 

.033“*' 

Psychomotor  Abilities 

.030“*' 

Mathematical  Knowledge 

.033*=**' 

Mathematical  Knowledge 

.030“*' 

General  Information 

.028'**' 

Mechanical  Comprehension 

.026**' 

Mechanical  Comprehension 

.026*=“' 

General  Information 

.021**'* 

Shop  Information 

.024**' 

Shop  Information 

.021**'* 

Electronics  Information 

.023**'^ 

Electronics  Information 

.020**'* 

Automotive  Information 

.020**'* 

Automotive  Information 

.016'* 

Numerical  Operations 

.016®* 

Numerical  Operations 

.013* 

General  Science 

.013'* 

General  Science 

.013* 

Geographic  Region 

.003* 

Geographic  Region 

.003* 

Tukey  =  .0202,  Alpha  =  .05,  K  =  38,  MSE  =  2.061,  DFE  =  756,  N  =  15 

Note.  Within-AFQT  category  values  with  same  letter  not  significantly  different. 
No  significant  differences  between  aptitude  levels. 
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